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ABSTRACT 


Some  problems  in  the  filtering  and  the  detection  of  diffusion  processes 
that  are  solutions  of  stochastic  differential  equations  are  studied. 

Transition  densities  for  Markov  process  solutions  of  a  large  class 
of  stochastic  differential  equations  are  shown  to  exist  and  to  satisfy 
Kolmogorov's  equations.  These  results  extend  previously  known  results 
by  allowing  the  drift  coefficient  to  be  unbounded.  With  these  results 
for  transition  densities  the  nonlinear  filtering  problem  is  discussed 
and  the  conditional  probability  of  the  state  vector  of  the  system  conditioned 
on  all  the  past  observations  is  shown  to  exist  and  a  stochastic  equation 
is  derived  for  the  evolution  in  time  of  the  conditional  probability 
density,  A  stochastic  differential  equation  is  also  obtained  for  the 
conditional  moments.  These  derivations  use  directly  the  continuous  time 
processes. 

Necessary  conditions  that  coincide  with  the  previously  known  sufficient 
conditions  for  the  absolute  continuity  of  measures  corresponding  to 
solutions  of  stochastic  differential  equations  are  obtained.  Applications 
are  made  to  the  detection  of  one  diffusion  process  in  another.  Previous 
results  on  the  relation  between  detection  and  filtering  problems  are 
rigorously  obtained  and  extended. 
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I.  INTRODUCTION  AND  PRELIMINARIES 


In  this  thesis  we  shall  study  some  filtering  and  some  detection 
problems  described  by  stochastic  processes.  These  problem  descriptions 
have  wide  applications  in  physical  problems  because  many  physical  phe¬ 
nomena  can  be  modeled  by  stochastic  processes. 

For  satellite  orbit  tracking  and  prediction  problems,  filtering  has 
been  effectively  used  to  obtain  "good"  estimates  of  the  satellite  orbits 
from  the  noisy  data  received  from  the  satellites  by  the  ground  stations. 
Missile  and  satellite  guidance  problems  typically  involve  noisy  measure¬ 
ments  from  the  various  sensors  and  filtering  theory  has  been  useful  in 
improving  guidance  performance. 

Many  communication  problems  involve  a  signal  corrupted  by  noise. 

This  signal  corruption  can  occur,  for  example,  by  the  thermal  noise  in 
transmitters  and  receivers  or  by  the  properties  of  the  medium  through 
which  the  signal  is  transmitted.  To  obtain  a  "good"  estimate  of  the 
signal,  the  received  data  must  be  filtered.  A  particular  type  of  communi¬ 
cation  problem  is  feedback  communication,  for  example,  the  communication 
from  a  ground  station  to  a  satellite  and  back  to  the  ground  station 
embodies  the  feedback  principle.  Filtering  can  be  shown  to  provide  a 
scheme  to  use  this  feedback  communication  channel  in  an  optimal  manner. 

Chemical  processes  can  often  be  modeled  by  stochastic  processes  where 
noisy  measurements  of -the  operations  are  obtained  and  filtering  theory 
can  be  used  to  obtain  "good"  estimates  of  the  operations.  Some  interest 
has  developed  for  applying  filtering  techniques  to  models  of  economic 
systems  which  include  random  behavior.  Identification  problems  where 
some  of  the  system  parameters  are  random  can  be  solved  by  applying 
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filtering  theory  to  obtain  "good"  estimates  of  these  random  parameters. 

•  k  _ 

In  many  stochastic  optimal  control  problems  the  state  vector  of  the 
system  is  described  by  a  stochastic  process  and  the  observations  made  on  * 

the  system  are  described  by  a  stochastic  process  which  is  a  function  of 
the  state  stochastic  process  and  noise.  The  control  problem  is  to  control 
the  state  of  the  system  optimally  (given  a  performance  criterion)  using 
the  observations.  These  stochastic  optimal  control  problems  form  a 
large  class  of  physically  important  problems.  The  conditional  probability 
of  the  state  given  all  the  past  observations,  which  is  obtained  for  the 
filtering  problem,  is  the  fundamental  tool  for  determining  the  optimal 
control  to  be  used  because  the  conditional  probability  represents  our 
probabilistic  knowledge  of  the  state  of  the  system.  The  filtering 
solution  with  the  conditional  probability  represents  a  major  step  to 
solving  the  stochastic  optimal  control  problem. 

Determining  whether  received  data  contain  a  signal  and  noise  or  merely 
noise  has  many  applications  particularly  in  radar  problems  where  a  signal 
is  sent  and  then  the  received  data  are  checked  to  determine  whether  the 
data  contain  a  reflected  signal  and  noise  or  only  noise.  To  make  the 
decision  in  an  optimal  manner  between  the  two  hypotheses  that  the  data 
contain  signal  and  noise  or  that  the  data  contain  noise  we  apply  some 
results  from  statistical  decision  theory  and  calculate  a  likelihood 
function.  This  likelihood  function  determined  from  the  data  is  then 
compared  with  a  threshold  to  indicate  the  hypothesis  to  choose.  For 
applications  it  is  useful  to  be  able  to  calculate  this  likelihood  function 
recursively,  i.e.,  to  obtain  a  differential  equation  for  the  evolution 
in  time  of  the  likelihood  function.  This  recursive  form  for  the  likeli- 

•  w 
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hood  function  car  often  be  obtained  by  applying  some  results  from 
filtering  theory. 

Before  analyzing  the  filtering  and  the  detection  problems  in  depth 
we  shall  discuss  some  of  the  history  of  £hese  problems  indicating  the 
results  that  have  been  obtained,  describe  the  results  that  we  shall  obtain 
and  describe  some  of  the  mathematical  techniques  and  results  that  will 
be  used  in  analyzing  the  filtering  and  the  detection  problems. 

A.  DESCRIPTION  AND  HISTORY  OF  THE  PROBLEMS 
1,  Nonlinear  Filtering 

The  filtering  problem  of  estimating  one  stochastic  process  given 
observations  of  a  related  stochastic  process  has  received  attention  in 
both  engineering  and  mathematics.  Kalman  and  Bucy  [Ref.  l]  modeling  the 
stochastic  processes  by  linear  differential  equations  with  white  noise 
inputs  obtained  a  simple  recursive  solution  to  the  linear  filtering 
problem.  The  obvious  extension  of  their  work  to  a  filtering  problem  with 
nonlinear  differential  equations  (i.e. ,  the  nonlinear  filtering  problem) 
has  been  discussed  by  a  number  of  authors,  Stratonovich  [Ref.  2],  Kashyap 
[Ref.  3],  Kushner  [Refs,  4,5,6],  Bucy  [Ref.  7],  and  Mortensen  [Ref.  8], 

The  original  studies  on  this  topic  were  somewhat  naive  and  i*  was  some 
time  before  it  was  realized  that  incorrect  (or  at  least  ambiguous)  results 
had  been  obtained  by  not  paying  proper  attention  to  some  of  the  mathe¬ 
matical  techniques  involved.  In  particular,  care  had  to  be  exercised  in 
interpreting  and  manipulating  certain  integrals — the  so-called  Ito  and 
Stratonovich  stochastic  integrals  [Ref,  <?]• 

The  aim  of  the  papers  on  this  problem  has  been  to  derive  a  differ¬ 
ential  equation  for  the  conditional  probability  density  (or  conditional 
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moments)  of  the  stochastic  process  to  be  estimated  given  all  the  past 
observations  of  a  related  stochastic  process.  The  most  general  results 
for  conditional  moments  that  have  been  rigorously  derived  have  been  obtained 
by  Kushner  [Ref.  6].  He  had  to  make  several  assumptions  on  the  stochastic 
processes  involved.  Often  these  assumptions  are  difficult  to  verify  for 
physical  models.  The  physical  meaning  of  many  of  the  assumptions  is 
unclear  end  often  the  assumptions  were  made  only  to  obtain  some  mathe¬ 
matical  results. 

One  reason  for  these  many  assumptions  is  that  the  problem  is  first 
solved  in  the  discrete  time  and  then  there  is  a  passage  to  the  limit  to 
obtain  the  continuous  time  result.  Mortensen  wut>  the  first  to  use  a 
purely  continuous  time  approach  though  he  made  some  fairly  restrictive 
assumptions. 

2.  Absolute  Continuity  of  Measures 

For  the  continuous  time  proof  of  the  existence  of  the  conditional 
probability  density  function  we  use  certain  results  on  the  absolute 
continuity  of  probability  measures  that  correspond  to  solutions  of 
stochastic  differential  equations  (stochastic  differential  equations  will 
be  defined  subsequently).  Prohorov  [Ref.  10]  obtained  the  first  results 
for  absolute  continuity  with  the  stochastic  processes  described  by 
stochastic  differential  equations  though  some  pioneering  work  on  this 
problem  was  done  by  Cameron  and  Martin  [Ref,  11],  Following  Prohorov, 
Skorokhod  [Refs.  12,13]  and  Cirsanov  [Ref.  14]  obtained  more  general 
results  on  sufficient  conditions  for  absolute  continuity. 

3.  Detection  Theory 

Some  detection  theory  problems  of  a  stochastic  signal  in  white 
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noise  have  been  solved  where  the  likelihood  function  (Radon-Nikodym  de¬ 
rivative)  can  be  recursively  calculated.  This  recursive  result  was 
obtained  by  Schweppe  [Ref,  15 ]  for  the  case  where  the  signal  is  generated 
by  white  noise  into  a  finite  dimensional  linear  system.  His  solution 
makes  use  of  the  linear  filtering  results  of  Kalman  and  Bucy  [Ref.  l]. 

Van  Trees  [Ref.  1 6]  has  considered  a  related  problem  obtaining  the  same 
"type"  of  result  as  Schweppe.  Sosulin  and  Stratonovich  [Ref.  IT]  consider 
the  signal  as  a  general  diffusion  process  and  indicate  that  the  nonlinear 
filtering  results  can  be  used  to  solve  recursively  for  the  likelihood 
function. 

B.  NEW  RESULTS 

We  will  briefly  describe  some  of  the  results  obtained  in  this  disser¬ 
tation. 

1,  Nonlinear  Filtering  Theory 

We  present  a  rigorous  derivation  of  a  stochastic  equation  for  the 
evolution  of  the  conditional  probability  density.  The  proof  works  directly 
with  the  continuous  time  stochastic  processes  and  no  "discretizations" 
are  used.  We  also  prove  existence  and  differentiability  properties  for 
transition  densities  corresponding  to  diffusion  solutions  of  stochastic 
differential  equations.  These  properties  are  used  in  the  derivation  of 
the  equation  for  the  conditional  probability  density.  The  main  results 
are  Theorems  2,1  and  4,1, 

2,  Absolute  Continuity  of  Measures 

We  derive  necessary  and  sufficient  conditions  for  the  absolute 
continuity  of  measures  corresponding  to  the  solutions  of  a  large  class 
of  stochastic  differential  equations.  This  result  is  given  in  Theorem  3«1* 
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3.  Detection  Theory 


We  consider  the  detection  problem  of  determining  whether  a 

stochastic  signal  (diffusion  process)  is  present  in  white  Gaussian  noise 

(Brownian  motion)  i.e.,  we  have  the  two  hypotheses  to  test 

< 

dyt  =  H(t)xt  dt  +  dB^  for  0=1 

A* 

=  dB^  for  0=0 

where  is  the  signal  and  dB^  is  the  noise.  We  rigorously  derive  a 

differential  equation  for  the  likelihood  function  and  relate  this  to  the 
nonlinear  filtering  problem.  We  compare  this  result  to  the  results  of 
Schweppe  [Ref.  15 ]  and  Sosulin  and  Stratonovich  [Ref.  17]  and  relate  the 
differences  to  the  different  definitions  of  stochastic  integral. 

We  consider  the  detection  problem  of  a  stochastic  signal  in  correlated 
noise  and  discuss  conditions  for  nonsingular  detection.  We  show  how  the 
nonsingular  problem  can  be  related  to  a  nonlinear  filtering  problem  to 
obtain  a  differential  equation  for  the  likelihood  function. 

C.  SOME  MATHEMATICAL  TECHNIQUES  AND  RESULTS 
1.  General  Theory  and  Notation 

A  number  of  mathematical  definitions  and  results  will  be  used  in 
this  dissertation  that  may  be  somewhat  unfamiliar  to  most  engineers.  We 
will  briefly  review  these  topics  here. 

Stochastic  processes  which  are  solutions  of  stochastic  differential 
equations  will  be  considered  here.  For  general  references  on  stochastic 
processes  and  particularly  to  stochastic  differential  equations  the  reader 
is  referred  to  Doob  [Ref.  18]  and  K.  Itb  [Ref.  19).  Some  familiarity  with 
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the  basic  definitions  of  probability  theory  and  stochastic  processes 
will  be  assumed.  Generally  a  stochastic  process  could  be  denoted  by  the 
four-tuple  (ft,3,P, (X^)  )  where 

i)  (ft,3>P)  is  a  probability  space,  i.e.,  a  measurable  space 
with  a  probability  measure  on  it.  For  our  case  we  will 
usually  consider  ft  to  be  the  space  of  continuous  functions 
on  T  =  [0,1],  3  then  is  the  Borel  a -algebra  for  ft  and 
the  probability  measure  P  is  a  measure  on  the  space  of 
continuous  functions.  The  points  in  ft  will  be  denoted  by 
cu. 

ii)  }  is  a  family  of  random  variables  on  (ft, 3)  with 
values  in  the  state  space  (E,£).  For  our  case  the  state 
space  (E,S)  will  usually  be  (£Rn,Bn)  where  Bn  is  the 
Borel  a-algebra  on  £Rn  (Euclidean  n- space).  The  time  set 
T  will  be  a  compact  interval,  usually  [0,1], 

We  define  B(X^,  u  <  t)  as  the  Borel  a-algebra  generated  by  the 
process  {X  ,  u  <  t),  A  family  of  (sub)  a-algebras  3.  is  said  to  be 
increasing  if  for  s  <  t  3  c  3+.  The  process  {X  }  is  said  to  be  adapted 
to  3t  if  is  3^  measurable.  For  example,  is  adapted  to 

B(Xy,  u  <  t).  We  will  assume  that  all  the  (sub)  a-algebras  are  augmented, 
i.e,,  if  71  =  (A  :  P(a)  =  0)  then  3  d  ji  for  V  t.  Without  this 
assumption  when  we  obtain  almost  sure  (a.s.)  equality  we  are  not  certair. 
that  all  versions  have  the  desired  measurability  properties  on  the  sub 
a-algebra. 

By  a  Markov  process  we  mean  fundamentally  a  stochastic  process  that 
has  the  so-called  Markov  property  (cf,  Loeve  [Ref.  20] )  i.e., 


P^AfuturelSpresent+pastj  ”  P^A future ^ Bpre sent  j  a,S* 

It  will  be  useful  to  define  more  precisely  the  motion  of  a  Markov 
process  (cf.  Pynkin  [Refs.  21,22]).  Take  a  measurable  space  (E,£).  The 
function  P(s,x;t,r)  (0  <  s  <  t,  x  £  E,T  £  £)  is  said  to  be  a  transition 
measure  if  the  following  conditions  are  satisfied: 

a.  P(s,x;t,T)  is  a  measure  (as  a  function  of  the  set  r) 

b.  P(s,x;t,r)  is  an  £  measurable  function  of  x 

c.  P(s,x;t,r)  <  1 

d.  P(s,x;s,E\x)  =  0 

e.  P(s,x;u,P)  =  J  P(  s,x;t,dv)p(t,y;u,r)  0  <  s  <  t  <  u 

E 

We  shall  also  need  the  notion  of  a  transition  density.  Let  |i  be  a 
measure  on  the  state  space  (E,£).  The  function  p(s,x;t,y)  (t  >  s;x,y  e  E) 
is  called  a  transition  density  if  the  following  conditions  are  satisfied: 

a,  p(s,x;t,y)  >  0  (t  >  s;x,y  e  E) 

P.  For  fixed  t  and  s  p(s,xjt,y)  is  an  £  x  £  measurable  function 
of  (x,y) 

r.  J  p(s,xjt,y)n(dy)  <  1  (t  >  s,x  e  E) 

5.  p(s,x;t,y)  =  J p(s,xju,z)p(u,z;t,y)|a(dz)  (s  <  u  <  t,x,y  £  E) 

E 

Under  certain  conditions  on  the  Markov  process  it  is  possible  to  show 
that  the  transition  density  function  exists  and  satisfies  the  following 
two  linear  second-order  parabolic  equations. 
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.  dp( s^y;t,x) 


dp(s^y;t,x) 


~2j  3x7  + 

i 


lVS2(Cij(t'X)p) 

2  2-t  ox"§x , 


(1.1) 


(1.2) 


where 


lim  i 
t  |  0  t 


(y  -  x)P(s,xjs  +  t,dy) 

<  & 


a(s,x) 


lim 

t  I  0  t 


(y  -  x)(y  -  x)TP(s,x;s  +  t,dy) 

<  & 


&  >  0 


c(s,x) 


These  equations  are  usually  called  Kolmogorov's  backward  and  forward 
equation  respectively.  The  reader  is  referred  to  Feller  [Ref,  23l  and 
Bharcuha-Reid  [Ref.  24]  for  a  more  complete  discussion  of  these  equations. 
Consider  a  process  {X^. }.  If  [X^J  is  a  Markov  process  then  for 
t  >  t  and  A  e  B(X^) 

p(aIVu^t)  “  p(A1xT)'  a’8’ 


If  we  can  replace  t  by  a  (random)  stopping  time  T(o>)  such  that 


{oo  :  T  <  s]  e  B(Xu,  u  <  s) 


and  if  T  <  t  and 
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P(a|Xu,  u<T)  =  PCaI^)  a.s. 

then  {X^}  is  called  a  strong  Markov  process. 

By  a  diffusion  process  we  mean  a  strong  Markov  process  with  continuous 
sample  paths. 

By  Brownian  motion  (also  called  the  Wiener  process)  we  mean  a  process 
{B(t,co),P}  which  has  continuous  sample  paths  whose  increments  are  inde¬ 
pendent  and  normally  distributed.  If  [B,  )  is  defined  for  t  6  [0,1] 
we  assume  B(0,o>)  =  0  and  E^j=t.  By  n-dimensional  Brownian  motion 
we  mean  a  system  of  n  one-dimensional  Brownian  motions  independent  of 
each  other. 

We  now  consider  integrals  with  respect  to  the  Brownian  motion  integrator, 
i.e.,  integrals  of  the  form 


J f(t)  dB(t,co) 

Since  Brownian  motion  has  unbounded  variation  we  cannot  interpret  this 
integral  (for  almost  all  oo)  as  a  Lebesgue-Stieltjes  integral,  Wiener 
[Ref.  25]  defined  this  integral  using  the  integration  theory  developed 
by  Daniell.  This  integral  can  be  defined  for  all  functions,  f,  that 
are  square  integrable  (cf.  Doob  [Ref,  18]  for  a  good  discussion), 

K.  Ito  [Refs,  19,26]  considered  the  problem  where  f  was  a  random 
function  independent  of  the  future  Brownian  motion.  He  first  defined  the 
integral  for  step  functions  as 
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n 

3  k  >  0  such  that  for  V  x  e  {R 

x^Ax  >  kx^x  =  k|  x|  ^  (1.6) 

The  proof  of  a  theorem,  lemma,  etc.,  begins  with  the  word  "proof"  and 
terminates  with  the  symbol  I  which  can  be  read  as  "this  completes  the 
proof. " 

2.  Theory  of  Stochastic  Differential  Equations 

We  will  have  occasion  throughout  this  dissertation  to  consider 
vector  stochastic  differential  equations  such  as 

dx(t,co)  =  a(t,x(t,co))  dt  +  b(t,x(t,o)))  dB(t,o>)  (1.7) 

where  x(t,co),  a(t,x(t,ai))  and  B(t,<u)  will  be  n  x  1  column  vectors 

and  b  will  be  an  n  x  n  matrix.  The  process  [B^)  is  n-dimensional 

Brownian  motion.  The  vector  a  is  usually  referred  to  as  the  drift  or 

transfer  vector  and  the  matrix  b  is  called  the  diffusion  matrix. 

We  shall  briefly  review  some  results  from  the  theory  of  stochastic 

differential  equations  that  will  be  used  in  later  chapters. 

a.  Existence  and  Uniqueness  of  Solutions  of  Stochastic 
Differential  Equations 

The  usual  results  for  existence  and  uniqueness  for  solutions 
of  stochastic  differential  equations  are  due  to  K.  I  to  [Refs.  19,26]  and 
I.  I.  Gikhman  [Ref.  27], 

Theorem  1.1.  Consider  a  vector  stochastic  differential  equation 

dx(t,<o)  =  a(t,x(t,o>))  dt  +  b(t,x(t,o>))  dB(t,o>)  (1.7) 


SEL-67-035 


12 


and  showed  that  this  definition  could  be  extended  to  all  functions  f 
satisfying 


J  J  |f(t,a>)|2  dt  dP  <  » 
a  t 


If  the  integrand  is  measurable  with  respect  to  the  past  Brownian  motion 

A 

then  by  Ito’s  definition  of  stochastic  integrals  this  integral  with  respect 
to  Brownian  motion  is  a  martingale  of  Brownian  motion,  i,e.,  for  t  <  t 


■{jfis, 


®)  dBs|B(Bu,  u  <  t) 


■  /f(s,a>)  dBs  a.s.  (1.3) 


This  martingale  property  will  be  important  in  many  of  our  calculations. 
Some  other  notational  descriptions  will  be  useful.  By  ^(L1,!00)  we 

1  00 

mean  the  weak  topology  induced  on  L  by  L  ,  A  description  of  weak 

topology  can  be  found  in  Royden  [Ref,  2?]  or  Kelley  [Ref.  28]. 

Given  a  matrix  a(t,x)  =  (a^j(t,x)}  we  say  that  a(t,x)  satisfies 

a  global  Lipschitz  condition  if  each  component  a. .  satisfies  this 

1 J 

property,  i.e.,  Vx,y 

laij(t,X)  "  aij<t^y)l  <  Klx  -  yj  i, J  =  1,2, . ,,,n  (1.4) 

Similarly  by  a(t,x)  being  bounded  we  mean  3  K  <  »  such  that  for  Vt,x 

I  a.iJ(t,x)|  <  K  i,<5  =  1,2, ...,n  (1.5) 

T 

Given  a  vector  or  a  matrix  A  we  denote  the  transpose  of  A  as  A  . 

By  a  symmetric  matrix  A  being  strictly  positive  definite  we  mean 
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where  t  e  [s,l],  x(s,co)  =  a(cD),  P[|a|  <  «)  =  1  and  the  terms  of 

the  vector  a(t,x)  and  the  matrix  b(t,x)  satisfy  a  global 

Lipschitz  condition  in  x  and  are  measurable  in  t.  Then  the 

solution  {x^)  exists,  is  unique,’  and  is  a  diffusion  process. 

2 

Furthermore  if  a  e  L  then 

sup  e(x^  )  <  00 
s  <  t  <  1  \  / 


Proof. 

The  idea  of  the  proof  is  to  use  Picard  iteration,  as 
x°(t,o))  =  a 

t  t 

xn+1(t,a>)  =  a  +  J  a(u,xn(u,a>))  du  +  J  b(u,xn(u,a)))  dB(u,a>)  (l.8) 
s  s 

to  show  that  8  solution  exists  and  that  it  is  unique.  The  integral  with 
respect  to  Brownian  motion  is  the  stochastic  integral  defined  by  K.  Ito. 

For  details  of  the  proof  and  the  stochastic  integral  the  reader  is  referred 

to  K.  ItQ  [Kefs,  19,26],  I 

b.  Stochastic  Differential  Rule 

Another  result  from  stochastic  differential  equation  theory 
will  be  important  in  the  following  presentation,  that  is,  the  stochastic 
differential  rule.  It  is  known  that  twice  continuously  differentiable 
functions  of  diffusion  processes  violate  some  of  the  usual  rules  for 
transformations  in  ordinary  calculus.  The  stochastic  differential  rule 
is  described  in  the  following  theorem  which  is  due  to  K.  Ito  [Ref.  30 ]. 
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Theorem  1,2.  Let  x(t,co)  satisfy 


dx(t,a>)  =  a(t,o))  dt  +  b(t,co)  dB(t,<o)  (1.9) 

where  we  assume  the  vector  a(t,a))  and  the  matrix  b(t,co)  are  inde¬ 
pendent  of  the  future  Brownian  motion  and  G  is  an  open  subset  of 
the  n- space  which  contains  all  the  points  (x(t,a)))  u  <  t  <  v 

a)  €  ft .  Let  f(t,x)  be  a  continuous  function  defined  for  u  <  t  <  v 
x  =  (x1,x2, . . «>xn)  e  G  and  suppose  that 


f°(t,x) 

Sf(t,x) 

at 

(1.10) 

f^tjX) 

af(t,x)  ,  ,  « 

(1.11) 

fiJ(t,x) 

a2f(t,x) 

(1.12) 

are  all  continuous.  Then  the  differential  of  ti( t,co)  =  f(t,x(t,a5)) 
is 


dT](t,05) 


=  ^jf°(t,x(t,u)))  +^fi(t,x(t;co))jai(t,cD) 

+  \  2  fiJ(t,x(t,05))ciJ(t,a5)j  dt 
+  ^  ^(^(t,®))^^,®)  dBj(t,co) 


(1.13) 


where  c(t,oo)  =  {c1j(t,a5)}  =  bi(t,05)b(t,05). 
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Proof. 


We  briefly  sketch  the  proof  to  give  the  reader  an  idea  of  the  tech¬ 
niques.  By  the  Taylor  expansion  of  f^x1,  we  have 


m 

n(s,o>)  -  T](t,<a)  « 


where  r  =  (^r^^k-l)' *  * ’^n^k-l))'  ^  “  t  +  (k/“)(s  -  t).  Since 

fi^(t,x1, ,,.,xn)  are  continuous  and  x^t,^)  i  =  l,2,...,n  are  all 

continuous  in  t  a.s.,  e*?,,  tends  to  0  uniformly  in  m  and  k  as 

i  j  k 

n  -*  oo  a. 8,  Therefore  the  last  term  in  the  above  expression  goes  to  zero 
in  probability.  It  can  be  shown  that 


(x1(s,cd)  -  xi(t,0)))(xJ(s,0))  -  Xj(t jCd) ) 
s 

=  /[(x±( T,<a)  -  xi(t,a)))aJ(x,(o)  +  (xj(t,o>)  -  xJ(t,co))ai(T,cs) 


+  -  xi(t,a>))blk(T,<p)  +  (Xj(t,co)  -  Xj(t,a)))blk(r,a))]  dBk(r,a>) 

t  (1.15) 
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Using  this  result  the  remaining  terms  in  the  Taylor  expansion  are: 
(suppressing  the  summation  signs) 

s  s 

/( f°(a)  +  fi(a)ai(T)  +|  fiJ(a)C;Lj(T))dT  +  /f^oOb^T)  dBj(x) 


a 

+  |/  ^(^[(x^t)  -  x1(xm(T)))aj(T)  +  (xj(T)  '  xj(xm(T^^T^]  dT 
t 

8 

+  |/f1J(a)[(Xi(T)  -  x^Xj-rJUb^t)  +  (Xj(t)  -  xJ(Xm(x)))-blk(T)]  M^t) 


where  X  (t)  denotes  the  maximum  tf  which  does  not  exceed  t  and 
nr  '  k 

a  =  (\(T),x1(Xm(T))i...,xn(Xm('r))).  Since  x^xJt))  -  x^t)  a.s. 
the  last  two  integrals  in  the  above  expression  go  to  zero  in  the  limit 
and  we  have  the  result.  I 

To  illustrate  the  application  of  the  stochastic  differential  rule 
we  provide  two  examples  (which  will  also  be  used  subsequently). 

Example  1. 

Consider  the  function  given  by 


Mt  =  exp 


J aT(u,x(u,o)))c"1(u,x(u,a)))  dx(u,co) 


-  J  aT(u,x(u,a)))c_1(u;x(u,a)))a(u,x(u,cD))  du 


T  *1 

where  dx(u,cn)  =  b(u,x(u,oo))  dB(u,co),  c  =  b  b,  and  b  exists. 
The  function  can  therefore  be  rewritten  as 


(1.16) 
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*  i 


t 

-  J  aT(u,x(u,<D))c-1(u,x(u,<D))a(u,x(u,a)))  du 
s 


(1.17) 


Let 


dzt  =  aT(t,xt)bT  (t,xt)  dBt 


-  \  aT(t,xt)c‘1(t,xt)a(t,xt)  dt 


(1.18) 


Then 


(1.19) 


We  shall  now  apply  the  stochastic  differential  rule  (Theorem  1.2)  to  the 
z. 

function  e  ,  We  first  compute  the  derivatives  of  e 


d  x 
-s—  e 
dx 


,2  x 
d  e 


dx 


Substituting  these  terms  in  Eq.  (1.13)  we  have  the  following 
equation  for 

t  _i 

M.  =  1  +  f  M  a^(u,x  )b^  (u.x  )  dB 
t  J  u  '  7  u7  '  7  u7  u 

s 


t 

"  \  /MuaT(^xu)c’1(u;xu)a(u^xu)  du 
s 


T  rp“l  “1 

M  a  (u.x  )b  (u.x  )b  (u.x  )a(u.x  )  du 

u  '  7  u7  '  7  u7  v  7  u7  '  7  u7 


(1.20) 


17 


SEL- 67-035 


(1.21) 


Recalling  that  c  =  b  b  we  have 

t 


M. 


L  -1 

=  1  +  f  M  a^(u,x  )b^  (u.x  )  dB 
J  u  '  *  u7  x  *  u'  u 


or  written  as  only  a  functional  of  x^,  s  <  u  <  t  we  have 

t 


=  1  +  /  M  aT(u.x  )c~^(u,x  )  dx 

J  u  v  9  u'  v  *  u'  u 


(1.22) 


Example  2. 


Find  the  differential  for  where 


Ex  exp 


/  gT(u,xu,yu)  dBu  -  \  /gT(u,xu,yu)g(u,Vyu)  du 


w 

■  1+  %  f  dBu 


(1.23) 


where  =  E^(t^ )  and  we  assume 

t 


%  -  1  ,/V\!<"’V,»1)  dBu 

s 


(1.24) 


The  expression  for  the  differential  of  q,  can  be  written  down  formally 

w 

as 


afa1)  -  -  4  aot  ♦  H 

\  /  q: 


(1.25) 


since  the  differential  rule  can  be  characterized  as 


df 


t  =  ft  dxt  +  \  ft'(dxt)2 


(1.26) 


and  since  the  term  (dq^)  arises  only  from  the  stochastic  integral  via 
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our  differential  rule  we  have 


~2  dBt  +  “i  ^(*tg^t'^,yt^TEx^',rtg^t,Vyt^dt 

3t  qt 

(1.27) 

c.  Sufficient  Conditions  for  the  Absolute  Continuity 
of  Diffusion  Processes 

We  now  consider  the  following  stochastic  differential 

equations, 

dx(t,<o)  =  a(t,x(t,o)))  dt  +  b(t,x(t,u>))  dB(t,o))  (1,7) 


dy(t,(n)  =  f(t,y(t,o>))  dt  +  g(t,y(t,o>))  dB(t,o)  (1.28) 


Almost  all  sample  functions  of  these  two  stochastic  processes  [x  }  and 

t 

(yt)  are  continuous  functions.  Therefore  we  can  describe  the  stochastic 
processes  [x^)  and  {y^}  by  measures 
n-dimensional  space  of  continuous  functions  Cn[s,l],  We  shall  give 
sufficient  conditions  for  ^  to  be  absolutely  continuous  with  respect 
to  iiy.  (written  ^  «  i^). 

In  terms  of  stochastic  differential  equations  the  first  results  were 
obtained  by  Prohorov  [Ref,  10]  though  some  important  pioneering  work  in 
Wiener  measure  (the  measure  induced  by  Brownian  motion)  was  done  by 
Cameron  and  Martin  [Ref,  ll].  Subsequent  to  Prohorov,  Skorokhod  [Ref,  13 ] 
and  Girsanov  [Ref,  14]  considered  the  problem  and  obtained  more  general 
results.  We  state  the  result  due  to  Girsanov  in  the  following  theorem. 


,  say  jjj. 


on  the 
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Theorem  1.3.  Suppose  that 


lx(t,co)  =  a(t,x(t,co))  dt  +  b(t,x(t,a>))  dB(t,o)) 


(1.7) 


dy(t,o))  =  (a(t,y(t,o)) )  +  b(t,y(t,o>))h(t,y(t,o})))  dt  +  b(t,y(t,o>))  dB(t,o>) 

(1.29) 


where 

i)  te  [s,l] 

ii)  h(t,y(t,c»))  =  (h1(t,y(t,a)))Jh2(t,y(t,a)) . .,hn(t,y(t,o)) )  )T 

iii)  a(.,«),  b(.,«)  and  h(*,«)  are  measurable  in  both  variables 
1 

iv)  f  |  b(t,x(t,co))|  2  dt  <  oo  a.e. 
s 

1 

f  |  h(t,x(t,a>))|  2  dt  <  oo  a.e. 
s 

1 

J  |  a(t,x(t,a>))|  2  dt  <  oo  a.e. 

s 

v)  |h(t,x(t,0>))|  <  ho(|x(t,<n)|  ) 


where  hQ  is  a  nondecreasing  function  of  a  real  variable.  Then 


where  and  are  the  measures  induced  on  Cn [ s ,  1  ]  by  {x^} 

and  {y^}  respectively. 

The  Radon-Nikodym  derivative,  dj^/dn,  will  be  given  by 
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II.  TRANSITION  PROBABILITY  DENSITIES  FOR  DIFFUSION  PROCESSES 


Markov  processes  which  are  solutions  of  stochastic  differential 
equations  generated  by  Brownian  motion  are  often  used  to  describe  the 
nonlinear  filtering  problem  and  the  stochastic  optimal  control  problem. 

A  fundamental  tool  for  these  problems  is  the  conditional  density,  viz., 
the  probability  density  for  the  process  to  be  estimated  conditioned  on  all 
the  past  observations.  The  expression  for  the  conditional  probability 
density  is  a  function  of  the  transition  density  for  the  Markov  process 
which  is  to  be  estimated.  Therefore  to  derive  an  expression  for  the 
conditional  probability  density  rigorously  it  is  first  necessary  to  prove 
that  this  associated  transition  density  exists.  To  derive  a  stochastic 
equation  for  the  conditional  probability  density  it  is  necessary  to  prove 
that  the  transition  density  is  differentiable  enough  to  satisfy  Kolmogorov's 
forward  equation  (the  Fokker-Planck  equation). 

In  this  chapter  we  shall  consider  stochastic  differential  equations 
which  have  diffusion  process  solutions,  and  (i)  prove  that  the  transition 
density  with  respect  to  Lebesgue  measure  exists  for  the  diffusion  process, 
(ii)  prove  that  this  transition  density  is  suitably  differentiable  and 
that  the  various  derivatives  can  be  bounded  so  that  the  density  function 
can  be  characterized  as  the  fundamental  solution  of  Kolmogorov's  equations. 
A.  EXISTENCE  AND  DIFFERENTIABILITY  OF  TRANSITION  DENSITIES 

We  now  consider  the  problem  of  showing  that  the  solution  of  the 
following  vector  stochastic  differential  equation 

dx(t,cu)  =  a(t,x(t,cu) )  dt  +  b(t, x(t,cu) )  dB(t,cu)  (2.1) 
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with  suitable  assumptions  on  the  coefficients  has  a  transition  density 
and  that  this  density  satisfies  Kolmogorov's  forward  and  backward  equations. 
In  previous  work  on  this  problem,  both  a  and  b  were  assumed  to  be 
bounded  and  bolder  (or  Lipschitz)  continuous.  Under  these  assumptions, 
Mortensen  [Ref.  8  ]  established  existence  of  the  density,  while  Dynkin 
[Ref.  2l]  proved  that  the  density  existed  and  that  it  satisfied  Kolmogorov's 
equations. 

We  make  the  following  assumptions  on  the  coefficients 

i)  The  diffusion  matrix  b(t,x)  is  Holder  continuous  in 

t,  globally  Lipschitz  continuous  in  x  and  globally  bounded. 
Moreover,  the  symmetric  matrix  c  ^c  =  bTb^  is  strictly 
positive  definite.  The  terms 


8c,  ,(t,x) 


Sx'dXj 


i, j  ®  1, 2, . , ,,n 


are  globally  Lipschitz  continuous  in  x,  continuous  in  t 
and  globally  bounded, 

ii)  The  transfer  (drift)  vector  a(t,x)  is  continuous  in  t  and 
globally  Lipschitz  continuous  in  x.  The  terras 


8a  (t,x) 

i  =  1,2, ...,n 

are  globally  Lipschitz  continuous  in  x  and  continuous  in 

t. 

We  state  our  result  in  the  following  theorem. 
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Theorem  2.1.  Let  x(t,o>)  satisfy 

dx(t,oi)  =  a(t,x(t,<o))  dt  +  b(t,x(t,<n))  dB(t,oa)  (2.1) 

where  we  make  the  assumptions  on  the  coefficients  described  above. 

Then  there  exists  a  version  of  the  transition  density  for  (x^),  px, 

which  satisfies  Kolmogorov' s  equations. 

Before  presenting  the  proof  we  shall  briefly  outline  the  steps.  We 
first  show  that  Kolmogorov' s  backward  equation  is  naturally  associated 
with  the  stochastic  differential  equation  describing  {x^}  (Lemma  2.1). 

If  this  backward  equation  has  a  unique  fundamental  solution  then  we  can 
show  that  this  fundamental  solution  is  the  transition  probability  density 
for  (x^)  (Lemma  2.2).  Furthermore,  if  we  can  show  that  the  formal 
adjoint  of  the  backward  equation  has  a  unique  fundamental  solution  and 
that  for  large  values  of  the  space  coordinates  the  fundamental  solution 
decreases  sufficiently  rapidly,  then  we  can  prove  that  the  transition 
density  satisfies  Kolmogorov' s  forward  equation. 

Since  the  coefficient  a(t,x^)  in  the  stochastic  differential  equation 
can  be  unbounded  the  usual  results  for  existence  and  uniqueness  of  funda¬ 
mental  solutions  for  linear  second-order  parabolic  equations  cannot  be 
used.  We  proceed  by  first  showing  existence  of  the  transition  density 
relating  it  to  a  simpler  process  (Lemma  2,3)  and  then  finally  proving  that 
the  transition  density  is  suitably  differentiable  (Lemma  2.4). 

1.  Kolmogorov1 s  Equations 

Since  we  want  to  show  that  a  transition  density  for  a  diffusion 
process  exists  and  satisfies  Kolmogorov' s  equations  we  have  to  use  some 
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techniques  and  results  from  the  theory  of  partial  differential  equations. 

In  particular  it  will  be  useful  to  define  a  fundamental  solution  of 
a  partial  differential  equation. 

Definition.  A  function  p(s,y;t,x)  defined  for  x,y  e  g;n  and  s  <  t, 
s,t  e  T  =  [0,  l]  is  a  fundamental  solution  of  £f  =  0  if  it  has 
the  following  two  properties 

a.  Considered  as  a  function  of  (x,t)  for  each  fixed 

(s,y)  e  $n  $j)  [0,1]  the  derivatives  of  p  which  appear  in  £ 
exist,  are  continuous,  and  satisfy 

£P  =  0  in  Sn(g)(0,l)  (2.2) 

b.  If  h  is  a  continuous  real  valued  function  on  an  with  compact 
support  then 

lira  f  p(s,y;t,x)h(y)  dy  =  h(x  )  (2.3) 

*  (x,t)-(xo,s+)-'n 

We  will  now  associate  Kolmogorov’s  equations  with  the  vector  stochastic 
differential  equation 

dx(t,co)  =  a(t,x(t,co))  dt  +  b(t,x(t,co))  dB(t,co)  (2.1) 

Lemma  2.1.  Let  g  be  a  bounded  real  valued  twice  continuously  differ¬ 
entiable  function  defined  on  g?n.  Let  (x^)  satisfy 

dx(t,a>)  =  a(t,x(t,o>))  dt  +  b(t,x(t,o>))  dB(t,o>)  (2.1) 
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where  we  assume  the  vector  a(t,x)  and  the  matrix  b(t,x)  satisfy 
a  global  Lipschitz  condition  in  x  and  are  continuous  in  t,  and 
the  matrix  c  (c  =  b^b)  is  strictly  positive  definite  and  x(s)  =  y. 

Let 


f(s,y;t)  =  E^s  y)g(x(t,a>))  (2.4) 

Then  f(s,y;t)  as  a  function  of  (s,y)  satisfies  the  following 
linear  second-order  parabolic  equation 


(2.5) 


Proof. 

This  result  follows  from  the  stochastic  differential  rule  (Dynkin 
[Ref.  21])  and  Dynkin1  s  formula.  | 


We  now  show  that  if  the  partial  differential  equation  described  in 
the  above  lemma  has  a  unique  fundamental  solution,  then  by  the  properties 
of  a  fundamental  solution  we  can  characterize  it  as  the  transition  density 
of  (xt). 


Lemma  2.2.  If  the  linear  parabolic  equation  in  Lemma  2.1 


df 

ds 


(2.5) 


has  a  unique  fundamental  solution,  p,  then  p  is  the  transition 
density  for  the  diffusion  process  {x^)  which  satisfies 
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dx(t,o>) 


a(t,x(t,a>))  dt  +  b(t,x(t,a>))  dB(t,co) 


ana  therefore  the  transition  density,  p,  satisfies  Kolmogorov' s 
backward  equation. 

Proof. 

Using  the  definition  of  fundamental  solution  we  can  show  that 
can  be  expressed  as 

f(s,y;t)  =  J g(x)p(s,y;t,x)  dx  (2.6) 

We  recall  a  standard  result  from  measure  theory  that  bounded  twice  con¬ 
tinuously  differentiable  functions  can  approximate  in  measure  any  essentially 
bounded  function,  i.e.,  bounded  twice  continuously  differentiable  functions 

/  i  oo\  1 

are  dense  in  the  weak  topology  a  I L  ,L  /  Induced  on  the  space  L  by 
the  space  L°°  (cf.  Royden  [Ref.  27]  or  Halmos  [Ref.  31]).  Therefore 
the  probability  for  any  Borel  set  can  be  obtained  from  the  fundamental 
solution  as  a  limit  of  twice  continuously  differentiable  functions.  The 
other  properties  of  a  transition  density  also  follow  from  the  properties 
of  a  fundamental  solution,  I 

We  have  therefore  shown  that  the  transition  density  satisfies  Kolmogorov' s 
backward  equation. 

We  will  now  sketch  the  arguments  to  obtain  the  forward  equation.  The 
formal  adjoint  of  the  backward  equation  is 
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V R w-rw— v» -PVF  innvn'ivrrmvi 


Sf  _  V  d(ai(t>x)f)  lV^  (c1j(t>x)f) 

St  Zj  Sx  +  2  Z,  5x!oxT  '  *  ' 

i  1  i,3  1  J 

Assuming  that  a  fundamental  solution,  p,  exists  and  is  unique  for  the 
backward  equation,  to  show  that  p  satisfies  the  adjoint  equation 
(Kolmogorov's  forward  equation),  besides  assuming  the  appropriate  differ¬ 
entiability  of  a,  c  and  p,  we  must  assume  that  the  following  terms, 
obtained  by  integrating  by  parts  to  derive  the  forward  equation,  cure 
zero. 


p(s,y;t,x)ai(t,x) 


=  0  i  =  1,2, ...,n  (2.8) 


-p(-s,yit*x)c  ,(t,x) 


=  0  i, j  =  1,2, ...,n  (2.9) 


d(p(s,yjt,x)c  (t,x)) 

- - 


=  0 


j  -  2, , .  • ,  n 


(2.10) 


We  have  shown  that  if  Kolmogorov’ s  backward  equation  has  a  unique 
fundamental  solution  then  this  fundamental  solution  is  the  transition 
density  for  the  process  (x^),  If  we  assume  the  appropriate  differenti¬ 
ability  assumptions  for  the  coefficients  a  and  c  to  make  Kolmogorov's 
forward  equation  meaningful  and  we  assume  this  forward  equation  has  a 
unique  fundamental  solution  with  the  above  equations  (Eqs.  2.8,  2.9, 

2.10)  being  satisfied  then  we  will  have  shown  that  the  transition  density 
satisfies  Kolmogorov's  forward  equation. 
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2.  Usual  Results  for  Existence  end  Uniqueness  of  Fundamental 
Solutions  of  Linear  Parabolic  Equations 

To  prove  existence  and  uniqueness  of  the  fundamental  solutions  of 
Kolmogorov' s  equations  we  make  use  of  some  of  the  usual  results  for 
fundamental  solutions  of  linear  second-order  parabolic  equations.  We 
review  these  results  now. 

Consider  the  general  linear  homogeneous  second-order  parabolic  equation 
in  the  strip  H  =  (0, l] 


\yu  au(s’y)  SV5V  +2bi(s,y)  %  •  o(s'y)u  +  i 

i,J-l  J  i=l 


(2.11) 


The  following  theorem  is  due  to  II* in,  Kalashnikov  and  Oleinik  [Ref.  32] 
(cf.  also  Refs.  33,3*0. 


Theorem  2.2.  Suppose  that  all  the  coefficients  of  the  above  equation  are 
bounded  and  continuous  in  H  in  the  set  of  variables  s,y  and  that 
they  satisfy  a  Holder  condition  in  y: 


a,  -  a  (s,y)|  <  M|  y'  -  y| 


I  t>i(  s,y' )  -  bi(s,y)|  <M|y'  -  y|  X  >  i  ,i  =  1,2, ...,n 


X  >  0 


I  c(s,y')  -  c(s,y)|  <  M|  y'  -  y| 


In  addition  suppose  that  the  coefficients  a.  satisfy  in  H  a 
Holder  condition  in  s: 


I  ai j ( s ^ , y)  -  aid(s,y)|  <  M|  s'  -  s| 
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and 


n  n 

^  a^Ky)^  >  H  >  0 

i,j=l  1=1 

for  all  (s,y)  €  H  and  real  numbers  a.., a  ,  .  ,.,a  .  Then  the  parabolic 
equation  has  a  fundamental  solution  p(s,y;t,x)  and  this  solution 
is  unique.  For  p(s,y;t,x)  we  have  the  following  estimates 


p(s,y;t,x)  >0,  s  <  t,  s,t  e  [0,1], 


p(s,y;t,x'  <  K(t  -  s)  exp  j^-a|  y  -  x|  2/(t  -  s)j, 
d^S^p-tf3^  <  K(t  -  s)"(n+1^/2  exp  ^-a|y  -  x\2/(t  -  s)j, 

|  <  ^  -  8>"n/2  exP  -  ^/(t  "  ■>], 


where  K  and  a  are  positive  constants. 
If  the  derivatives 


i,J  =  1,2, 


n 


are  bounded  and  continuous  in  H  and  satisfy  a  Holder  condition  in 
y,  then  p(s,yjt,x)  as  a  function  of  t  and  x  satisfies  the 
equation 


32(a11(t,x)p] 

^ldxj 


S[bi(t,x)p] 


-  o(t,x)p-^ 
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0 

(2.12) 


•^r«a^rrT.^~vVTrv^Tycr  X71JTIVK^XTJ!k  ^OTfT  Mi  T* MWJ 


3.  Existence  of  the  Transition  Density 


To  show  the  existence  of  the  transition  density  for  (x^J  we 
apply  a  technique  used  hy  Mortensen  [Ref.  8],  We  first  introduce  a 
"simpler"  process  {y. j  satisfying 

U 

dy(t,<a)  =  b(t,y(t,o>))  dB(t,<o)  (2.13) 

Using  the  results  for  existence  and  uniqueness  of  the  fundamental 
solutions  for  linear  second-order  parabolic  equations  with  bounded  Holder 
continuous  coefficients  (Theorem  2.2)  we  can  easily  show  that  the  tran¬ 
sition  density  corresponding  to  (y^),  Py>  exists,  is  unique  and  satisfies 
Kolmogorov's  forward  and  backward  equations 

8Py(s,y;t,x) 

5s 

8py(s,y;t,x) 

<5t 

To  show  that  the  transition  density  for  {x^},  Py,  exists  and  is 
suitably  differentiable  is  more  difficult  because  a  can  be  unbounded. 

We  first  obtain  the  existence  of  p  by  using  the  results  for  absolute 

A 

continuity  of  the  measures  of  solutions  of  stochastic  differential 
equations  (Theorem  1.3). 

Lemma  2,3.  Let  {y^}  and  { x^. )  satisfy 

dy(t,a>)  =  b(t,y(t,co))  dB(t,co)  (2.13) 


1  V"'  Jfc'v 

2Zcit5(s,y)  Sy.Sy. 
i,J  J 


(2.14) 


2^'  ^  (c^j(b,x)Py) 

2Z 


i  j 


(2.15) 
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dx(t,co) 


a(t,x(t,o>))  dt  +  b(t,x(t,<o))  dB(t,o>) 


(2.1) 


where  t  e  [s,l.]  x(s)  =  y(s)  =  y. 

Then  «  (x^.  and  the  transition  density  exists  for  the  process 
(x  )  and  a  version  of  it  for  all  t  6  [s,l]  is  given  by 

"G 


Px(s,y;t,x)  =  E[cpt|xt  =  x]pY(s,y;t,x) 


(2.16) 


where  ^  and  are  the  measures  induced  on  Cn[s,l]  by  {x^} 

and  {y^)  respectively  and 


s  <  u  <  t) 


exp 


t 

f  aT(u,yu)c_1(u,yu)  dyu 

s 


t 

-  \  J  |b"1(u,yu)a(u,yu)|  2  du 
s 


(2.17) 


T 

c  =  b  b.  The  function  cpt  is  the  Radon-Nikodym  derivative  di^/duY 
for  the  processes  {x^J  and  (yu)  s  <  u  <  t. 

Proof. 

The  fact  that  follows  from  Girsanov's  theorem  (Theorem  1.3). 

Fix  t.  Let  A  e  Then 


(^(a) 


(2.18) 


We  can  replace  cp.^  by  cp^  in  the  above  equation  because 

(cpt,  B(Bu,  s  <  u  <  t))  is  a  martingale.  This  will  be  discussed  further 
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in  the  next  chapter  (Lemma  3.5). 


^(A)  =  / cpt  %  =  /  E[cpt |xt]  d^ 

A  A 

=  f  E[cpt|xt  =  x]py(s,y;t,x)  dx  (2.19) 

A 

By  the  Radon-Nikodym  theorem  we  have 

Px(s,y;tfx)  =  E[cpjxt  =  x]pY(s,y;t,x)  a.e.  dx  (2.20) 

We  can  also  immediately  obtain  this  result  for  a  countable  set  S  dense 
in  T  =  (s,l].  To  show  that  this  representation  is  valid  for  all  t  e  (s,l] 
we  proceed  as  follows.  Let  t  S,  t  e  (s,l]  and  consider  sets 

A  =  {x  <  a)  e  B(x  ),  a  €  gjn.  These  probabilities  can  be  obtained  from 
S  by  the  continuity  of  the  sample  paths  and  these  sets  generate  B(x. ). 

"G 

So  we  can  obtain,  via  a  limit,  the  conclusion  for  V  A  e  B(x, ).  I 

"C 

4,  Differentiability  of  the  Transition  Density 
Lemma  2.4,  The  transition  density  for  the  process  fx^},  p,,,  satisfies 

Z  A 

Kolmogorov1  s  equations. 

Proof. 

We  will  consider  primarily  Kolmogorov' s  forward  equation  since  the 
additional  results  for  the  backward  equation  follow  by  the  same  techniques. 
We  recall  a  few  preliminaries  first.  Let 
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(2.21) 


sup 
<  t  < 


x(t,co)|  <  m! 


Since  (x,  )  has  continuous  sample  paths  we  have 
z 


1  =  lim  P(fi„) 
M  -  oo  M 


(2.22) 


Also 


sup 

s  <  t  <  1 


<  00 


Heuristically  our  approach  is  quite  simple.  Consider  sets 


Tn  =  (x  :  |  x|  <  n)  ® (0,1],  We  will  give  a  Green's  function  for 
which  is  not  difficult  to  construct  since  the  coefficients  of  the  partial 
differential  equation  are  bounded  on  this  set.  For  large  M,  P(nM)  «  1 
so  that  a  description  of  the  transition  density  when  the  coefficients 
are  bounded  is  (in  some  sense)  a  good  approximation  for  the  unbounded 
case.  We  will  show  that  the  sequence  of  Green' s  functions  is  monotone 
increasing.  Since  we  showed  that  the  density  function  for  the  diffusion 
process  {x^}  exists,  we  are  able  to  bound  this  increasing  sequence. 

For  T  the  Green's  function  p  (s.yjt.x)  for 
n  nx  ’  '  ' 


£(.,  .  a(;>  iya  (°i.i(t’x),)  *«!<*,»>•> 


-j.-jV  /  V*  '  i'  * 

Sx.dx  +  2-i  dx. 

1  J  .  X 


(2.23) 


exists  and  has  the  properties  described  earlier  for  fundamental  solutions 
of  parabolic  equations  with  bounded  coefficients  (Theorem  2.2), 
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It  follows  easily  from  probabilistic  considerations  that 


Pn(s,y;t,x)  dx  <  1 

<  n 


|y|  <n  0<s<t<l 


(2.24) 


and  similarly 

f  pn(s,yjt,x)  dy<l  |x|<n  0<s<t<l  (2.25) 

|y!<n 

Let  z  e  gjn  be  fixed  and  let  \(r  be  a  smooth  nonnegative  function 
with  compact  support  such  that  z  is  in  the  interior  of  the  support  of 
t.  Choose  m  so  large  that  the  support  of  \|r  is  contained  in  |  x|  <  m. 
Define  f ^  (j  =  m,  m  +  1)  as 

fj(s,y)  =  /  Pj(s,y;t,x)\Kx)  dx  (2.26) 

|x|  <  j 


Then  fj  satisfies  the  differential  equation  in  Tn  and  for  s  =  t  f j  =  \|/ 

and  f  ^  >  0  =  f^  on  |  x|  =  m.  Hence  by  the  maximum  principle  for 

partial  differential  equations  [Ref.  33]  f  ,  >  f  in  T  .  If  we  then 

m+i  —  m  n 

replace  by  a  sequence  of  nonnegative  functions  which  approximate  the 
Dirac  measure  concentrated  at  z  we  obtain 


P  >  P 
m+1  —  m 


in  T 


m 


since  |  z|  <  m  is  arbitrary.  We  extend  the  definition  of  p^  to  £Rn 
by  defining  Pm  =  0  if  |  x|  or  |  y|  >  m.  Thus 
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°<P!<P2  <  —  <Pm<W^  •" 

for  Vx,y  6  fBn,  t,s  e  [0,1],  t  >  s. 

The  sequence  (p  )  has  a  finite  limit  a.e.  (=p)  but  we  must  show 
that  this  limit  is  a  solution  of  the  parabolic  equation,  i.e., 


£p  =  0 

(2.27) 

We  could  in  fact  bound  the  sequence  by  the  estimates  obtained  for  parabolic 

equations  with  bounded  coefficients  since  the  constant  a  in  Theorem  2.2 

can  be  shown  not  to  depend  on  the  boundedness  of  b  and  c  and  the 

constant  K  can  be  simply  related  to  the  coefficients  b  and  c. 

Therefore  for  t  >  s  x,y  e  $n 

lira  pn(s,y;t,x)  =  p(s,y;t,x)  a.e. 
n 

(2.28) 

is  well  defined  (actually  everywhere).  It  follows  by  the 

is  bounded  and  by  Fatou's  lemma 

above  that  p 

J p(s,y;t,x)  dx  <  1 

(2.29) 

J  p(s,y;t,x)  dy  <  1 

(2.30) 

Consider  a  bounded  domain  DCS11®  [0,l]  and  let  t  >  s.  Choose 

another  bounded  domain  E  such  that  D  C  E  C  E  C  $n  (g) ( s, l] ,  Choose 

m  so  large  that  E  C  T  .  By  the  Schauder-Barrar-Friedraan  interior 

ra  * 

estimates  [Ref.  33] 
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are  uniformly  bounded  and  equicontinuous  in  D.  Hence  by  the  Ascoli 
theorem  [Ref.  27]  there  exists  a  subsequence  of  (pn)  which  together 
with  its  derivatives  converges  uniformly  to  p  in  D.  Therefore 


JSP  =  0 


(2.31) 


But 


P 


n 


-  P 


Thus 


P=P  on  D  (2.32) 

and  since  D  was  an  arbitrary  bounded  domain 

£P  =  0,  x,y  €  £Rn,  s  <  t,  s,t  €  [0,1] 

For  completeness  we  should  show  that  p  is  indeed  a  fundamental 
solution  but  this  is  straightforward  and  will  therefore  be  omitted. 

We  should  also  verify  that  the  assumptions  on  p  to  derive  the 
forward  Kolmogorov  equation  are  valid.  These  assumptions  are  easily 
verified  since 


sup  E 
0  <  t  <  1 


<  00 


37 


SEL-67-035 


and  c  is  bounded 


The  fact  that  p  is  a  transition  density,  i.e., 

J P  =  1  (2.33) 

as  well  as  the  uniqueness  of  the  fundamental  solution  follow  from  our 
proof  for  existence  of  the  density.  | 

B.  SOME  REMARKS 

Remark  1. 

Theorem  2.1  is  quite  analogous  to  a  result  obtained  by  Eidelman 
[Ref.  3^1.  For  other  results  for  linear  parabolic  equations  with  unbounded 
coefficients  the  reader  is  referred  to  Krzyzanski  and  Szybiak  [Ref,  35  ]> 

S.  Ito  [Ref.  36],  and  Aronson  and  Besala  [Ref.  37]. 

The  method  of  proof  given  here  seems  to  simplify  somewhat  the  usual 
construction  of  fundamental  solutions  by  exploiting  the  probabilistic 
interpretation  of  the  parabolic  equation. 

Remark  2. 

We  have  obtained  the  existence  and  uniqueness  of  a  transition  density 
for  a  diffusion  process  which  is  the  solution  of  a  stochastic  differential 
equation  and  have  shown  that  it  is  suitably  differentiable  when  some  of 
the  coefficients  can  be  unbounded.  Existence  and  uniqueness  of  the  tran¬ 
sition  density  is  not  true  for  arbitrary  smooth  but  unbounded  coefficients. 

We  construct  an  example  from  one-dimensional  diffusion  theory  to  show 
that  for  some  smooth  but  unbounded  coefficients  we  will  not  obtain  a 
usual  density  function,  i.e., 


SEL-67-035 


38 


(2.34) 


fp  <  i 

and  the  density  function  will  not  be  unique. 

Consider  Brownian  motion  on  the  interval  [-jt/2,jt/2],  It  is  intuitively 
clear  (and  not  difficult  to  prove)  that  almost  all  sample  paths  of  the 
Brownian  motion  will  hit  the  boundaries  (x  =  -jt/2,n/2).  With  suitable 
boundary  conditions  we  can  have  a  set  of  sample  functions  of  positive 
probability  absorbed  at  the  boundaries. 

Now  we  define  a  diffusion  process  on  the  extended  real  line  by  applying 
the  smooth  one-to-one  transformation 


y  =  tan  x 


(2.35) 


to  the  Brownian  motion  on  the  interval  [-jt/2,jt/2].  Therefore  we  have 
that  a  set  of  sample  functions  of  positive  probability  of  the  new  diffusion 
process  is  absorbed  at  the  boundaries  (x  =  +<»,-<»).  To  clearly  characterize 
this  new  diffusion  process  we  compute  its  differential  generator  recalling 
that  the  differential  generator  for  Brownian  motion  is 


1  dff 
5  a*2 


We  obtain  the  differential  generator  for  y^  =  tan  B^  by  applying  the 
chain  rule  for  differentiation  to 


f(y)  =  f(tan  x) 


(2.36) 


We  obtain 
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df  _  df 

^ 


52f  _  d^f  &£  df  d2y 

ax2  ’  a/3*3*  ^ax2 

We  use  the  following  elementary  results 

2 

sec  x 

2  sec2x  tan  x 
tan2x  +  1 

to  obtain  the  differential  generator 

Hi+/)  y  -  4 + 4 £  <2-39) 

for  the  diffusion  process  on  the  real  line.  The  diffusion  process  that 
we  have  constructed  has  the  property  that 

f  dP  <  1  (2.40) 

where  P  is  the  transition  measure  for  the  process.  Furthermore,  by 
our  construction  it  follows  that  the  above  differential  generator  (Eq.  2.39) 
does  not  correspond  to  a  unique  diffusion  process. 


d  tan  x 
dx 


.  2 
d  sec  x 

dx 


2 

sec  x 


(2.37) 

(2.38) 
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Remark  3, 

Random  initial  conditions  for  the  stochastic  differential  equations 
cause  no  difficulty  for  determining  a  transition  density  if  we  assume  that 
these  random  variables  have  a  finite  second  moment  (though  finiteness 
a.s.  suffices),  that  these  random  variables  are  independent  of  the  Brownian 
motion,  that  the  corresponding  probability  measures  for  these  random 
variables  have  a  density  with  respect  to  Lebesgue  measure  which  is  suitably 
differentiable,  and  that  we  change  the  various  a-fields  and  the  proba¬ 
bility  measure  P  to  include  these  random  variables. 
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III.  THE  ABSOLUTE  CONTINUITY  OF  MEASURES  OF  DIFFUSION  PROCESSES 


The  main  objective  of  this  chapter  is  to  obtain  necessary  and  suf- 

ficent  conditions  for  the  absolute  continuity  of  the  measure  of  the 

solution  of  one  stochastic  differential  equation  with  respect  to  the 

measure  of  the  solution  of  another  stochastic  differential  equation  and 

to  obtain  an  explicit  expression  for  the  density  function  in  the  space 

of  continuous  functions.  The  necessary  and  sufficient  conditions  derived 

» 

here  are  analogous  to  the  conditions  obtained  for  Gaussian  processes  with 
independent  increments  [Ref.  12],  To  obtain  these  conditions  a  charac¬ 
terization  for  the  density  function  will  be  given  which  will  indicate  to 
some  extent  its  structure. 

The  conditions  for  absolute  continuity  of  the  measures  of  solutions 
of  stochastic  differential  equations  have  application  in  communication 
theory  to  the  detection  problem  when  the  two  hypotheses  can  be  modeled 
by  stochastic  differential  equations.  The  characterization  of  the  density 
function  should  be  useful  for  acquiring  a  better  understanding  of  the 
nonlinear  filtering  problem  and  the  associated  stochastic  optimal  control 
problem. 

The  main  result  of  this  chapter  is  the  following  theorem. 

Theorem  3.1.  Let  {x^}  and  (y^)  satisfy 

dx(t,<o)  =  a(t,x(t,co))  dt  +  b(t,x(t,o>))  dB(t,co)  (3.1) 

dy(t,£D)  =  f(t,y(t,<s))  dt  +  g(t,y(t,a>))  dB(t,co)  (3.2) 

where  t  €  [0,1],  x(o)  =  y(o)  and  the  coefficients  a,b,f  and  g 
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satisfy  a  global  Lipschitz  condition  in  the  second  variable  and  are 
continuous  in  the  first  variable  and  the  diffusion  matrices  b  and 
g  have  inverses  for  all  values  of  their  two  variables.  For 


(3.3) 


it  is  necessary  and  sufficient  that 


,T,  T 

b  b  =  g  g 


(3.M 


Corollary.  For  the  density  function  can  be  written  as 

a  functional  of  only  x  ,  0  <  u  <  t 


M(xu,  0  <  u  <  t)  =  exp 


f  ( f(s,x(s,co))  -  a(s,x(s,a))))Tc“1(s,x(s,a)))  dx(s,a)) 


-  J  (f(s,x(s,cn))  -  a(s,x(s,<n)))Tc  1( s,x( s,cu))a( s,x( s,cd))  ds 
0 

t 

jj  f  (f(s,x(s,<u))  -  a(s,x(s,<o)))Tc“1(s,x(s,a>))(f(s,x(s,a>))  -  a(s,x(s,ci>)))  ds 
0 

(3.5) 

vhere 


T 

c  =  b  b 


(3.6) 


We  note  that  while  this  theorem  is  similar  to  the  condition  for 
Gaussian  processes  we  have  had  to  be  more  restrictive  in  our  assumptions 
than  in  the  Gaussian  case  since  we  have  had  to  assume  that  the  diffusion 


matrices  have  inverses 


A.  SOME  SUFFICIENT  CONDITIONS  FOR  ABSOLUTE  CONTINUITY 

To  obtain  necessary  and  sufficient  conditions  for  the  absolute  conti¬ 
nuity  of  measures  of  solutions  of  stochastic  differential  equations  we 
must  first  obtain  an  extension  of  the  known  sufficient  conditions  for 
the  absolute  continuity  of  the  measures.  The  extension  is  not  difficult 
using  some  techniques  and  results  of  Skorokhod  [Ref.  13].  We  first  present 
some  of  Skorokhod' s  results. 

1.  Skorokhod 's  Results 


Lemma  3«I«  If  b(t  x)  and  g(t,x)  are  continuous  in  t  and  satisfy 
a  global  Lipschitz  condition  in  x,  then  the  process  |x|.0:^|  and 


defined  for  a  =  {0,t1 ,  • . .  ,t/v  =  1)  as 


V  ” '  a 

t 


x^t,®)  =  x^a^(tk,<o)  +  j b^tk,x^a\tk,a>)^  dB(s,<n)  (3.7) 


t 

y^(t,a>)  =  y^(tk,oo)  +  / 8 dB(s»a))  (3.8) 


for  t  e  [tk,tk+1J  and 


x(o,a>) 


y^a^(o,(n)  =  y(o,cn) 


will  for  every  t  e  [0,1]  =  T  converge  in  probability  to  the  solutions 
of 


SEL-67-035 


44 


x(t,<o)  =  x(o,£d)  +  f  b(s,x(s,a>))  dB(s,o>)  (3.9) 

■o 

t 

y(t,flo)  =  y(0,o)  +  J  g(s,y(s,o>))  dB(s,cu)  (3.10) 

0 

as  "  *]C)  ■*  0  (i«e.,  the  partitions  become  dense  in  the 

interval  [0,1]). 


Lemma  3.2.  Let  the  finite-dimensional  distributions  of  the  processes 
£n(t)  and  rjn(  "t )  converge  weakly  to  the  finite-dimensional  distri¬ 
butions  of  the  processes  £(t)  and  t)( t ),  respectively,  and  let 
P^n),  P.^,  p|,n),  and  P2  136  measures  in  function  space  corre¬ 
sponding  to  the  processes  £n(t),  C(t),  Tln(t)  and  T](t).  Moreover, 
(n) 

let  the  measure  P£ be  absolutely  continuous  with  respect  to  the 
(n) 

measure  P£,  for  all  n,  let 


dP'  ' 

(x(t)) 


be  the  density  of  pj with  respect  to  pln\  and  let 


lira 
N  -  00 


_  dP^ 

lira  p(  | log— fa  (x  (t))|  >nJ  =  0 

n  -►  oo  dP),  ' 


(3.H) 


Then  the  measure  P^  is  absolutely  continuous  with  respect  to  the 
measure  P^. 
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Lemma  3.3.  Let  the  processes  £  (t),  £(t),  p  (t),  r|(t)  satisfy  the 


(ri)  (n) 

conditions  of  Lemma  3.2,  and  moreover,  let  dPg  exist.  If 


sn(t)  -  £(t),  T)n(t)  -  ^(t)  and 


7^^ 


(U‘» 


in  probability,  then 


p  - 


(3.12) 


Theorem  3.2.  Let  £.(t)  and  £2(t)  Gaussian  processes  with  independent 


increments  such  that 


Ee  J  =  exp|  -  2  (Aj(t)z,z)| 


(3.13) 


In  order  that  ^  be  absolutely  continuous  with  respect  to 

2 


Hj.  (t)  it  is  necessary  and  sufficient  that  A^t)  =  Ag(t). 


2.  New  Result 


With  these  results  of  Skorokhod  we  are  now  in  a  position  to  extend 


the  sufficient  conditions  for  absolute  continuity. 


Theorem  3.3.  If  the  processes  {x^}  and  (y^)  are  defined  as  the 


solutions  of  the  stochastic  differential  equations 
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(2) 

continuous  with  rejpect  to  the  measure  P)  '  v  corresponding  to  the 


(d) 

process  x(t).  We  denote  1  as 


^a\t,(x>)  =  x(tk,o))  +  ^t^x(tk,<o)^a^  t  €  [tR,tk+1]  (3.19) 


and  by  Lemma  3«1 


x^  in  probability  t  e  [0,1] 


Since 


dp(2) 

^(5(t))si  (3.20) 

dP'1' 

the  conditions  of  Lemmas  3.2  and  3.3  are  satisfied  and  therefore 

“y<<mx 

Similarly 

1 

B.  CHARACTERIZATION  OF  THE  DENSITY  FUNCTION 
1.  Assumptions 

Before  considering  necessary  conditions  for  the  absolute  continuity 
of  the  probability  measures  we  will  make  some  assumptions  as  to  the  type 
of  stochastic  differential  equations  to  be  considered  and  assumptions  on 
the  coefficients  in 
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dx(t,<o)  =  b(t,x(t,co))  dB(t,co) 


(3.14) 


dy(t,co)  =  g(t,y(t,m))  dB(t,co)  (3.15) 

where  bT(t,x)b(t,x)  =  gT(t,x)g(t,x)  for  all  t  e  [0,1],  x  e  &n, 

b  and  g  satisfy  a  global  Lipschitz  condition  in  x  and  are 

-1  T 

continuous  in  t  and  c  exists  where  c  =  b  b,  b  and  g  are 

n  x  n  matrices  and  (x^. },  {y^J  and  (B^J  are  n-dimensional  processes 

then 


dx(t,o>)  =  a(t,x(t,a>))  dt  +  b(t,x(t,<o))  dB(t,<u) 
dy(t,co)  =  f(t,y(t,u>))  dt  +  g(t,y(t,a>))  dB(t,a>) 


where 


x(t,a>) 

y(t,cu) 

B(t,co) 

a(t,x(t,aj)) 

b(t,x(t,o>)) 

f(t,y(t,o>)) 

e(t,y(t,o))) 


(xj(t,a>),...,xn(t,a>))T  t  e  [0,1] 

T 

(y1(t,<ja),...,yn(t,a))) 

(B1(t,o),...,Bn(t,oj))T 

{a^tjxCt,^))) 

{biJ(t,x(t,<u))} 

{i*i(t,y(t,co))) 

{gi  j('t,y('fc,cD) ) ) 


(3.1) 

(3.2) 


Assumption.  We  will  assume  that  the  coefficients  satisfy  a  global 

Lipschitz  condition  in  the  space  variable  and  are  continuous  in  the 
time  variable  and  that  the  diffusion  matrices  b  and  g  have 
inverses  for  x  e  &n,  t  e  T.  We  will  assume  the  interval  of  solution 
of  these  equations  is  T  =  [0, l]  anc^  that  x(0)  =  y(o)  although  of 
course  this  last  assumption  on  the  initial  conditions  can  be  weakened 
to  the  case  where  these  random  variables  have  measures  that  are 
equivalent. 
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By  the  real  valued  function  M,  on  C„[0,t]  we  will  mean  the 
density  function  when  where  and  correspond  to  the 

measures  induced  by  the  solutions  of  the  respective  stochastic  differ¬ 
ential  equations  above.  By  the  Radon- F  Kodym  theorem  we  have  for 
A  e  B(y  ,  0  <  u  <  t). 


Hy(A)  =  /  M t  d 


(3.21) 


2.  Uniform  Integrability  and  Some  Results  From  Martingale  Theory 

Definition.  Let  A  be  a  subset  of  L^QjSjP).  A  is  uniformly  integrable 
if 


sup  J  |  X(co)|  P(do)  -+  0  as  n  -+  oe 

X  6  A  (|X|  >  n) 


The  following  results  indicate  the  importance  of  uniform  integrability. 

Theorem  3.4.  Let  (f  )  be  a  sequence  of  integrable  random  variables 

that  converge  a.e.  (or  in  probability)  to  a  random  variable  f.  Then 
f  is  integrable  and  the  convergence  of  fR  to  f  takes  place  in 
the  L^  norm  if  and  only  if  the  fn  are  uniformly  integrable. 

Theorem  3.5  (Compactness  Criterion  of  Dunford-Pettis ).  Let  A  be  a  subset 
of  the  space  l\  The  following  three  properties  are  equivalent: 

i.  A  is  uniformly  integrable. 

ii,  A  is  relatively  compact  in  L^  in  the  weak  topology  a^L^,L°°j. 

iii.  Every  sequence  of  elements  of  A  contains  a  subsequence  that 
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converges  in  the  sense  of  the  topology 
We  state  some  well  known  results  from  martingale  theory. 

Proposition  3»1  (Jensen's  Inequality).  Let  c  be  a  convex  mapping  of  $ 
into  a  and  let  X  be  an  integrable  random  variable  such  that  the 
composition  c  O  X  is  integrable.  The  following  inequality  then  holds 

c  0  E[X|§]  <  E[c  0  X|g]  (3.22) 

where  g  is  a  sub-o-field  of  Sf. 

Theorem  3,6.  Let  (X^)  be  a  right-continuous  (or  only  separable) 

t€£R  + 

supermartingale  where  a  is  the  positive  half  line 

a.  Suppose  that 

sup  E^X^j  <  oo 


The  random  variables  X^  then  converge  a.s.  to  an  integrable 

random  variable  X  as  t  -♦  oo, 

00 

b.  Suppose  that  the  X^  ere  uniformly  integrable.  The  above 

condition  is  then  realized,  the  process  (X^)  is  a 

tea+u{°°)  i 

supermartingale,  and  the  convergence  takes  place  in  the  L 
norm. 

c.  Suppose  that  the  X^  are  uniformly  integrable  and  that  the 

process  (X.)  is  a  martingale.  The  process  (X,  )  is 

1  1  tegi+uM 

then  a  martingale. 


The  above  results  can  be  found  in  Meyer  [Ref,  38]*  The  following 


results  for  accessary  conditions  were  developed  through  discussions  with 
S.  Watanabe. 

3.  Functionals  of  Brownian  Motion 

Our  first  task  is  to  give  some  general  representation  for  the 
density  function  M^.  To  accomplish  this  we  will  have  to  obtain  some 
preliminary  results  on  representations  of  martingales  of  Brownian  motion. 

Definition.  The  sub-c-algebras  are  defined  as 

Bt  =  B(\>  0  <  u  <  t) 


Theorem  3.7.  Any  L functional  of  n-dimensional  Brownian  motion  can  be 
represented  by  an  infinite  sum  of  stochastic  integrals  plus  a  constant. 

Corollary.  Every  square  integrable  martingale  of  Brownian  motion  can  be 
represented  by  an  infinite  sum  of  stochastic  integrals  plus  a  constant. 


and  {Yt,£?t  }  is  a  martingale.  By  the  martingale  convergence  theorem 
(Theorem  3*6)  3  one  and  only  one  (up  to  equivalence)  such  that 


(3.23) 


Yt  =  E[Y1|Btl  a.  s. 


By  It o' s  representation  we  can  write 
1 

Yi  .  £/«  i(s,o»)dB8+c 


(3.24) 


i  0 


Yt  =  E 


U 


■  I 


E 


J  Vs*  a>)  dBsiet 

+  c 

0 

P*  M 

t 

'l 

f\M  «,l  et 

+  Is 

y  ^i(s,co)  dB jBt 

0 

i 

0 

+  c 


(3.25) 


where  the  {#,(s,o))}  are  n  dimensional  vectors  which  are  measurable 

1  s 

for  each  s.  (The  integrand  product  above  will  mean  throughout  this 
chapter  the  usual  inner  product.)  Since  {Y.,  £.}  is  a  square  integrable 

U  t 

martingale  the  first  sum  is  £  t  measurable  and  the  second  sum  is  zero. 
Thus 


v 

■  If  *i(s,co)  dBg  +  c  a.s. 

i  0 


(3.26) 


This  was  done  for  fixed  t.  Since  the  martingale  is  continuous  we  can 
apply  the  result  to  a  countable  dense  T  set  and  we  therefore  have  for 
all  t 

t 

Yt  =  Y  f  <Pi(s,cu)  dBs  +  c  a.s.  |  (3.27) 

*  0 


In  our  attempt  to  characterize  the  density  function  it  is  necessary 
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to  relate  the  c-algebras  B(xu,  0  <  u  <  "t)  and  B(yy,  0  <  u  <  t)  to 
B(B  ,  0  <  u  <  t). 

Lemma  3.4.  For  all  t 

B(yu,0<\i<t)  =  B(x  ,  0  <  u  <  t)  =  B(B  ,  0<u<t)  (3.28) 

Proof. 

We  will  prove  only  the  last  equality  i.e., 

B(xu,  °<u<t)  =  B(Bu,  0  <  u  <  t)  (3.29) 

since  the  other  proof  follows  similarly. 

Since  the  coefficients  of  the  stochastic  differential  equation  are 

Lipschitz  continuous  we  can  apply  the  recursive  formula  (Picard  iteration) 

that  K.  Ito  uses  to  prove  existence  and  uniqueness  of  the  solution  of 

n  til 

stochastic  differential  equations.  If  we  let  x  (t,<a)  be  the  n 
solution  in  the  recursive  procedure  we  clearly  have 

B(v  0  -  u  -  *)  C  B(BU>  0  <  u  <  t) 

Since  we  are  performing  a  countable  operation  we  can  pass  to  the  limit 
and  obtain 

BUu,  0  <  u  <  t)  C  B( Bu,  0  <  u  <  t) 

Conversely,  since  the  diffusion  matrix  is  nonsingular  given  any  x(t,a>) 
we  can  determine  B(t,oo)  and  therefore 
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B(xu,  0  <  u  <  t) D  S(BU,  0  <  u  <  t)  | 

We  rerrark  that  this  result  is  not  always  true  as  Ito  and  Nisio  [Ref.  40] 
have  indie. ated.  They  modify  an  example  of  Girsanov  and  show  that 

B(xu,  0  <  u  <  t)  £  B(Bu,  0  <  u  <  t) 

Conversely,  trivial  examples  when  the  diffusion  matrix  is  singular  will 
show  that  the  other  cr-algebra  inclusion  is  not  always  valid,  i.e., 

B(xu,  0  <  u  <  t)  b(Bu,  0  <  u  <  t) 

We  use  the  result  of  the  preceding  lemma  (Lemma  3.4)  to  make  the 
following  assertions  about  the  density  function  and  subsequently  to  derive 
an  expression  for  the  density  function. 

Lemma  3.5.  The  density  function  M^.  is  a  martingale  of  Brownian  motion. 
Corollary.  The  density  function  is  a  continuous  function  of  t. 

Proof  (Lemma). 

Let  A  €  B(y  ,  0  <  u  <  t)  =  s(B  ,  0  <  u  <  t)  and  let  t  >  t 

I Mt  d^  =  Je[Mt|  et]  d^  =  j  Mt  d^  (3.30) 

A  A  A 

Therefore  E[M  |  B^\  =  a.s,  and  is  a  martingale. 

(Corollary).  If  is  square  integrable  it  follows  by  the 

2 

representation  for  L  martingales  of  Brownian  motion.  Otherwise  since 
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0  <  Mt  <  oo  a.s.  |i^  we  can  approximate  by  L  martingales  and  obtain 
the  result  by  the  martingale  convergence  theorem  (Theorem  3*6).  I 
4.  Decomposition  of  Supermartingales 

Doob  in  his  development  of  martingale  theory  gave  a  unique 
decomposition  of  super mart ingales  for  the  discrete  parameter  case  by  a 
simple  proof  explicitly  exhibiting  the  decomposition.  The  decomposition 
for  continuous  parameter  right  continuous  superraartingales  was  finally 
completely  solved  a  few  years  ago  by  P.  A.  Meyer.  The  problem  is 
complicated  a  great  deal  by  the  continuous  parameter  and  the  decomposition 
is  not  valid  for  all  continuous  parameter  super mart ingales  as  it  is  for 
the  discrete  parameter  case.  Thus  a  number  of  definitions  have  to  be 
given. 

The  concept  of  stopping  time  will  play  an  important  role  in  a  number 
of  the  proofs  given  subsequently.  A  stopping  time  is  defined  as  follows. 


Definition.  Let  (ft, 3)  be  a  measure  space  and  let  (3.)  be  an 

tea* 

increasing  family  of  sub-a-fields  of  3.  A  positive  random  variable 
T  defined  on  fi  is  said  to  be  a  stopping  time  of  the  family  {3^} 
if 


{co  :  T(o))  <  t}  e  3t  for  every  t  s  <r+ 

A  supermartingale  is  decomposed  into  the  difference  of  a  martingale 
and  an  increasing  process.  An  important  variety  of  increasing  process  is 
the  following,  since  it  will  insure  uniqueness  of  the  decomposition. 

Definition.  An  increasing  process  {A^}  is  said  to  be  natural  if  for 
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every  positive  bounded,  right-continuous  martingale  {Y^}  we  have 


ft  1 

’  t 

Y 

dA 

=  E 

f  Y  dA 

J  8 

s 

J  s-  s 

L° 

_0 

(3.31) 


Remark. 

If  {A. }  is  continuous  then  it  is  natural. 

Definition.  Let  {X^}  be  a  right-continuous  supermartingale  relative 

to  the  family  {8^}  and  let  fT  be  the  collection  of  all  finite 

stopping  times  relative  to  this  family  (respectively,  J  the 

collection  of  all  stopping  times  bounded  by  a  positive  number  a); 

{X.  }  is  said  to  belong  to  the  class  (D)  (respectively  belong  to 
"C 

the  class  (D)  on  the  interval  [ 0, a ] )  if  the  collection  of  random 
variables  X^  I  6  J  (respectively  T  e  is  uniformly  integrable. 

{X^.}  is  said  to  belong  to  the  class  (DL),  or  locally  to  the 
class  (D),  if  {X^}  belongs  to  the  class  (D)  on  every  interval 
[0,a]  (0  <  a  <  oo). 

Definition.  Let  T  be  a  stopping  time  relative  to  the  family  of  a-fields 
(tS .  )  .  We  denote  by  S_  the  collection  of  events  A  e  3  such 

*  t€3t+  T 

that 

AO  (T  <  t)  e  for  every  t  c  <s+ 

We  will  also  have  occasion  in  the  subsequent  work  to  use  the  optional 
sampling  theorem  in  the  continuous  parameter  case. 
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Theorem  3,8.  Suppose  that  for  the  supermart ingale  {X^}  there  exists 
an  integrable  random  variable  Y  such  that 

Xt  >  E[Y|u  ]  for  each  t  e  »+  (3.32) 

Let  S  and  T  be  two  stopping  times  such  that  S  <  T.  The  random 

variables  X0  and  X  are  then  integrable,  and  we  have  the  super- 
ST 

martingale  inequality 

Xs>E[XT|sg]  a.s.  (3.33) 

The  following  theorem  due  to  P.  A.  Meyer  [Ref.  38]  represents  a 
complete  solution  to  the  decomposition  of  right-continuous,  continuous 
parameter  supermartingales.  Its  proof  will  not  be  included  here,  but  it 
can  be  found  in  his  book  as  can  the  preceding  definitions. 

Theorem  3.9.  A  right- continuous  supermartingele  {X^)  has  a  decomposition 

Xt  =  Yt  -  At  (3.3^) 

where  {Y^}  denotes  a  right -continuous  martingale  and  [A^)  an 
increasing  process  if  and  only  if  {X^}  belongs  to  the  class  (DL). 
There  then  exists  a  decomposition  for  which  the  process  {A^}  is 
natural,  and  this  decomposition  is  unique. 

5.  An  Expression  for  the  Density  Function 

We  have  now  the  results  necessary  to  characterize  the  density 
function 
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Theorem  3.10.  If  the  density  function,  M^,  is  strictly  positive  (a.s. 
then  there  exists  a  function  ,<p  with  qp(  s,  • )  JSs  measurable 
such  that 


(3.35) 


Proof. 

By  two  previous  lemmas  we  have  that 

i.  is  a  martingale  of  Brownian  motion. 

ii.  Hj.  is  a  continuous  function  of  t. 

Recall  that  t  €  [ 0, l] .  Define  stopping  times  T  (with  respect  to  ]-  ) 

n  x 

as 


T  =  inf 
n 


{t  = 


M,  <  -  or  M.  > 
t  n  t 


"} 


(3.36) 


=  1  if  the  above  set  is  empty. 


It  is  elementary  to  verify  that  (Tn)  is  a  sequence  of  stopping  times 

of  the  family  ( /B . ),  Clearly  T  is  increasing  with  n  and  T  t  1 
x  n  n 


a.s* 


We  prove  the  latter.  If  T  <  1 

n 

Mt  >  n,  Vn  and  J  d^  =  +  «  or 


on  A  :  ix^(a)  >  0  then  either 
<  l/n,  V  n  end  =  0  on 


A 


A 

both  of  which  are  contradictions.  Note  also  that  lim  T  =  T  is  a 

n 

stopping  time  since  (Tn)  is  increasing.  We  truncate  the  density  function 

M,  by  use  of  the  stopping  times  T 
x  n 
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(3.37) 


The  pair 


(”^®T  ) 

'  /  \n' 


^  ■  MtAT 


is  a  martingale  by  the  optional  sampling  theorem. 


The  function,  ,  is  square  integrable  for  each  n.  We  now  consider 


^(n)  ,  „(n) 

'  =  log  M£  ' 


(3.38) 


i<n)  i, 


Since  '  is  bounded  away  from  zero  and  bounded  above  for  each  n 
E^|  log  <00  so  that  log  is  a  supermartingale  by  Jensen's 

inequality.  Since  xj.n^  is  bounded  above  and  below  it  is  easily  verified 
that  it  is  in  class  (D).  Therefore  we  apply  the  Doob-Meyer  decomposition 


and  obtain 


x(n)  =  Y(n)  _  A(n) 
"t  t  "t 


(3.39) 


where 


is  a  martingale  and  A^  ’  is  an  increasing  process. 


By  Meyer's  construction  of  the  decomposition,  the  increasing  process  A'  ‘ 

will  be  continuous  if  X^.  '  is  continuous.  Therefore  (see  remark  on 
/  _  \ 

page  57)  A^  '  is  natural  and  the  decomposition  is  unique  (Theorem  3*9). 
Since  A^n^  is  continuous  and  X^n^  is  bounded  it  follows  that  is 

Ob  "C 


is  continuous  and  square 


bounded.  Therefore  the  martingale  is  continuous  and  square 

integrable  and  can  be  represented  by  a  sum  of  stochastic  integrals  (which, 
because  of  the  continuity,  can  be  summed  to  one  stochastic  integral)  plus 
a  constant  term.  Since  M„  2  1  and  A^  =  0  (by  definition) it  follows 
from  Eq.  (3.39)  that  Yn  is  zero  and  therefore  the  constant  term  is  zero. 


Thus  we  can  write  X^  in  the  form 


4n)  =  jVn)(s,o>)  dBs  -  j 


(3.40) 
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(3.41) 


Let  m  >  n,  then 


M  _ 


t  ■L{t  <  Tn) 


where  I,.  ^  m  ,  is  the  indicator  function  for  the  set  ft  <  T  ). 
ft  <  T  }  1  —  nJ 

1  —  nJ 

By  the  uniqueness  of  the  decomposition 


A<n>  .  A<n>I 


t  ‘‘■{t  <  T  ) 
1  —  nJ 


(3.42) 


and  thus 


</n)(s,<n)  =  cp^m^(B,o))l{t  <  T  j 


(3.43) 


(n)> 


By  the  assumptions  on  and  the  definition  of  (M^.  ') 


*(n) 


=  lim  '  a.s.  ^ 

n  -♦  oo 


(3.44) 


thus  we  can  define 


A.  =  lim  A 


(n) 


n 


<p(V) 


lim 

n 


=  exp 


<P^(t,«) 

} ' cp(  s,co)  dBg  -  f  dA£ 


0 


a.s.  (3.45) 
a.s.  (3.46) 
(3.47) 


Let  dz(t,<n)  =  <p(t,<a)  dB^  -  dA^  and  apply  the  stochastic  differential 
rule  (Theorem  1,2)  of  K.  Ito  to 
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The  term  dA^  causes  no  difficulty  because  A^  is  of  bounded  variation. 
Thus 

t  t  t 

Mt  -  1  +  /  Ms<p(s,<»)  dBs  +  \  jMs|cp(s,flo)|  2  ds  -  /  Ms  dAs  (3.48) 
0  o  o 


By  definition  of  the  density  function 

E[Mt  -  13  =  0  (3.49) 

and  {Mj.  -  1,  •!■’  .  )  is  a  martingale  with 

‘t  t  t 

E  jMscp(s,o>)  dBs  +|  Jms|cp(s,<d)|2  ds  -  J  dAs  =0  (3.50) 

0  0  0 


Since  the  terras  inside  the  expectation  are  a  martingale  of  Brownian 
motion  this  implies 


(3.51) 

(3.52) 


C.  NECESSARY  AND  SUFFICIENT  CONDITIONS  FOR  ABSOLUTE  CONTINUITY 

We  now  have  established  the  preliminaries  necessary  to  obtain  the 
mein  result  of  this  chapter,  that  is,  necessary  and  sufficient  conditions 
for  the  absolute  continuity  of  measures  which  are  generated  by  solutions 


of  stochastic  differential  equations. 

Theorem  3.1.  Let  {x^}  and  (y  )  satisfy 

dx(t,a>)  =  a(t,x(t,o>))  dt  +  b(t,x(t,<jc>))  dB(t,m)  (3.1) 


dy(t,a>)  =  f(t,y(t,a>))  dt  +  g(t,y(t,to))  dB(t,to)  (3.2) 

where  t  e  [0,1],  x(0)  =  y(0)  and  the  coefficients  a,  b,  f,  g 
satisfy  a  global  Lipschitz  condition  in  the  second  variable  and  are 
continuous  in  the  first  variable  and  the  diffusion  matrices  b  and 
g  have  inverses  for  all  values  of  their  two  variables.  For  |i^  = 
it  is  necessary  and  sufficient  that 

bTb  =  gTg  (3.4) 


Corollary.  For  Hy  «  the  density  function  M^.  can  be  written  as 


a  functional  of  only  xy,  0  <  u  <  t 


M(xy,  0  <  u  <  t)  =  exp 


J  (f(s,x(s,o>))  -  a(s,x(s,u))))Tc“1(s,x(s,o)))  dx(s,co) 


0 


-fw  s,x(s,co))-  a(s,x(s,o))))Tc“1(s,x(s,<o))a(s,x(s,a)))  ds 


V 

-  \  J  ( f  ( s,  x(  s,o) )  -  a(s,x(s,0))))Tc'1(s,x(s,a)))(f(s,x(s,a>))  -  a(s,x(s,a>)))  ds 

(3.5) 


0 


wnere 
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c 


(3.6) 


T 
b  b 


Proof  of  Theorem  (Necessity). 

By  the  preceding  theorem  we  know  that  the  density  function  is 

of  the  following  form 


M,. 


(3.52) 


We  will  now  characterize  the  vector  function  cp  by  applying  the  stochastic 

2  2/  x  n 

differential  rule.  For  any  heC,  h  e  L  (dt  x  dP),  h  :  &  & 


lira  j  E 
t  i  0  Z 


r  t 


exp 


dBs  - 1/  ki 


2 

cp  I  ds 


0 


(h(x+) 


h(xQ)) 


h(yo)] 


T 

Li 

2 


lira 


■  fh' 

(3.53) 

E[Mt(h(xt) 

-  h(xQ))] 

(3.5^) 

lira  j  E 

(Mt  -  l)(h(xt) 

-  h(xQ))  +  (h(xt)  -  h( xQ ) ) 

1  (3.55) 

tj  0 

* 

J 

lira  E 

t  1  0  1 

(h(xt)  -  h(xQ) ] 

t]  =  ^  h"  +  ah' 

(3.56) 

where 


bTbh" 


32h  V 

dx .  3x  2-,  ik  kj 
1  J  k 
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We  recall  (somewhat  heuristically  here)  the  behavior  of  products  of 
ordinary  and  stochastic  integrals  as  t  ^  0 

t  t 

Jas  ds  J>t  dBT  ~o(t) 

0  0 

t  t 

J  as  ds  J  dBT  ~  o(t) 

0  0 

t  t  t 

fa  dB  f  p  dB  ~  fa  p  ds  ~  o(t) 

J  8  8  J  T  T  J  S  8 

0  0  0 

The  above  results  are  proved  by  K.  Ito  in  his  derivation  of  the  stochastic 
differential  rule.  Recall  also 

t 

Mt  •  1  -  /  Ms^s  <3-5T) 

0 

and 

t  t  t 

h<xt>  -  i(*0)  -  /»; as  as  +  |  /  h"As  as  +  J  h;t>8  dBB  (3.58) 
0  0  0 


(3.59) 


Therefore 
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lira  ^  E  Mt(h(xt)  -  h(xQ)) 
"t  41  0  L  - 


T 

=  h"  +  ah'  +  bcph' 

T 

=  h"  +  fh' 


(3.60) 

(3.53) 


The  last  equality  is  from  our  initial  calculation  (Eq.  3*53).  Since  this 

2  2 

was  done  for  arbitrary  h  €  L  (dt  x  dP),  h  e  C  we  have 


f  =  a  +  bcp 

<oo  a.s. 

Proof  (Sufficiency). 

The  proof  is  elementary  so  we  will  only  sketch  it.  First  define  a 
correspondence  between  measures  and  solutions  of  stochastic  differential 
equations  (where  we  have  suppressed  the  arguments  of  the  coefficients) 


Our  hypothesis  that 


insures  that  0  <  M, 


|i^  —  b  dB^ 

P2  ~  a  dt  +  b  dBt 

P3  -  g  dBt 

f  dt  +  g  dBt 
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Prom  the  usual  results  for  absolute  continuity  (Theorem  1,3)  we  have 


^  ^2 

and  from  our  extensions  we  have 


"3 


It  easily  follows  from  the  transitivity  of  the  absolute  continuity  relation 
that 

^2=  ^  1 

Proof  of  Corollary. 


We  note  from  our  proof  of  necessity  for  the  theorem  that 


f  =  a  +  bcp  (3.6l) 

so 

cp  =  b  1(f  -  a)  (3*62) 


and 


dB,  =  b 


L(dx^  -  a  dt) 


(3.63) 
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Upon  substituting  in  the  expression  for  the  density  the  above  quantities 
for  cp  and  dB^  we  obtain  the  result.  | 
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IV.  THE  CONDITIONAL  PROBABILITY  DENSITY 


A.  INTRODUCTION  AND  MAIN  RESULT 

Consider  a  vector  Markov  process  {x^}  satisfying 

dx(t,cu)  =  a(t,x(t,co))  dt  +  b(t,x(t,a)))  dB(t,co)  (4.1) 

whose  states  x^.  cannot  be  observed  directly  but  only  through  the  noisy 
observations 

dy(t,<o)  =  g(t,x(t,<u),y(t,o>))  dt  +  h(t,y(t,<n))  dB(t,o>)  (4.2) 
where  t  e  [s,l]  x(s)  =  a,  y(s)  =  0 

x(t,cs)  =  (x1(t,a>),ac2(t,cD)M..,xii(t,a>))T 

y(t,a>)  =  (y1(t,a)),y2(t,a>),...,ym(t,a)))T 

n  m 

a  is  a  vector  in  5  ,  b  is  an  n  x  n  matrix,  g  is  a  vector  in  & 

and  h  is  an  m  x  ra  matrix  and  (B^)  and  (B^)  are  independent 

Brownian  motions  in  $n  and  £Rra  respectively. 

Many  control  and  communication  problems  associated  with  these  stochastic 

differential  equations  require  knowledge  of  the  conditional  probability 

density  p(x,t|a, s,y  ,  s  <  u  <  t)  which  is  the  probability  density  that 

x ,  =  x  given  the  observations  B(y  ,  s  <  u  <  t)  and  that  x(s)  =  a. 

In  this  chapter  we  shall  show  that  such  a  conditional  probability 

density  function  exists  and  shall  give  a  formula  for  it  (Eq.  4.15).  This 

formula  is  difficult  to  '•/aluete  as  it  stands  and  therefore  we  shall  obtain 


69 


SEL-67-035 


from  it  a  stochastic  differential  equation  that  will  describe  the  evolution 
in  time  of  the  conditional  probability  density.  This  equation  is  a  non¬ 
linear  equation  and  except  in  certain  very  special  cases  [Ref,  4l]  no 
explicit  solutions  are  known. 

The  main  result  of  this  chapter  is  the  following  theorem. 

Theorem  4,1,  Let  {x^}  and  (y^)  satisfy 

dx(t,o>)  =  a(t,x(t,o)))  dt  +  b(t,x(t,o>))  dB(t,o>)  (4.1) 

dy(t,a>)  =  g(t,x(t,<n),y(t,tD))  dt  +  h(t,y(t,o>))  dB(t,co)  (4.2) 


where  x  =  a,  y  =  0,  t  e  [s,l],  {B. )  and  {B. )  are  independent 

S  S  b  b 

Brownian  motions  in  $n  and  $m  respectively  and 

i)  The  diffusion  matrix  b(t,x)  is  Holder  continuous  in  t, 
globally  Lipschitz  continuous  in  x  and  globally  bounded. 
Moreover,  the  symmetric  matrix  c  ^c  =  b^b]  is  strictly  positive 
definite.  The  terms 


(t,x) 


^^(tjX) 


1,2 


, . , 


n 


are  globally  Lipschitz  continuous  in  x,  continuous  in  t, 
and  globally  bounded. 

ii)  The  transfer  (drift)  vector  a(t,x)  is  continuous  in  t  and 
globally  Lipschitz  continuous  in  x.  The  terms 
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da^tjx) 

5x! 


i  —  1,2, ...,n 


are  globally  Lipschitz  continuous  in  x  and  continuous  in  t. 
iii)  The  transfer  (drift)  vector  g(t,x,y)  and  the  diffusion  matrix 
h(t,y)  satisfy  a  global  Lipschitz  condition  in  x  and  y  and 

/  m ' 

are  continuous  in  t.  Moreover,  the  symmetric  matrix  f  (f  =  h  hy 
is  strictly  positive  definite. 

Then  the  conditional  probability  density  p(x,t|  a, s,yy,  s  <  u  <  t) 
exists  and  satisfies  the  following  stochastic  differential  equation 


dP+ 


A  n  S2(ci1(t,x)pt)  ^,3(a1(t,x)pt)\ 

=  2  2  SxTSxT  Z  5xj  ) 

\  i,J=l  J  i=i  / 


dt 


+  (gt  -  gt)Tf;1(dyt  -  gt  dt) 


(4.3) 


where 


Pt  =  p(x,t|a,s,yu,  s  <  u  <  t) 

(4.4) 

gt  =  g(t,x,yt) 

(4.5) 

ft  - 

(4.6) 

fhe(t>xt’yt)  dMx 

/\  j 

et  '  r 

(4.7) 

J  *t 
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exp 


r  t 


*t  =  *t(  W  8  <  u  <  ^  = 


/gT(u,xu,yu)f_1(u,yu)  dyu 


\  /eT(u,xu,y u)f'1(u,yu)g(u,)iu,yu)  du 


(4.8) 


Stratonovich  [Ref.  2]  was  apparently  the  first  to  consider  the  non¬ 
linear  filtering  problem.  His  equation  for  the  evolution  of  the  conditional 
probability  differs  from  our  result  because  his  stochastic  integrals  are 
not  interpreted  in  the  K.  Ito  sense  [cf.  Ref.  9]»  Subsequent  to  Stratonovich, 

Kushner  [Refs.  4,5,6],  Kashyap  [Ref.  3l>  Bucy  [Ref,  7],  and  Mortensen 
[Ref.  8]  have  also  discussed  this  problem.  We  rigorously  derive  the 
stochastic  equation  for  the  conditional  probability  under  weaker  assumptions 
than  has  been  done  [Refs.  6,8],  The  style  of  proof  that  we  shall  give 
was  first  used  by  Mortensen  but  our  results  are  extensions  of  Mortensen’ s 
work  by  allowing  coefficients  of  the  stochastic  differential  equations 
to  be  unbounded  and  assuming  a  more  general  form  for  the  stochastic 
differential  equations.  Recently  Shiryaev  [Ref.  42]  has  sketched  a  proof 
of  the  equation  for  the  evolution  of  the  conditional  probability  density 
for  a  more  general  problem  than  we  have  considered  but  he  did  not  indicate 
the  assumptions  that  he  made  so  we  cannot  compare  the  results.  We  also 
derive  an  equation  for  the  conditional  moments, 

B.  PROOF  OF  THE  MAIN  RESULT 

Since  the  proof  is  long  and  quite  detailed  we  shall  first  outline 
the  major  steps  in  it.  We  first  prove  the  existence  of  the  conditional 
probability  measure  and  give  an  expression  for  it  (Lemma  4.1).  Recalling  .  ‘ 

our  result  from  Chapter  2  that  the  transition  density  exists  (Lemma  2.3) 
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we  prove  that  the  conditional  probability  density  exists  and  obtain  an 
expression  for  it  which  involves  the  transition  density  (Lemma  4,2). 

Prom  this  expression  for  the  conditional  probability  density  we  shall 
obtain  a  stochastic  equation  for  the  evolution  of  this  conditional  proba¬ 
bility  density.  To  do  this  we  shall  need  a  Fubini-type  result  for  a 
stochastic  integral  and  an  ordinary  integral  (Lemma  4,3),  Having  this  we 
then  establish  a  stochastic  equation  for  the  unnormalized  conditional 
probability  density  (Lemma  4.4).  Finally  we  combine  this  result  with  the 
differential  for  the  normalization  constant  to  obtain  the  main  result. 

We  shall  need  to  define  various  quantities  and  symbols.  Our  funda¬ 
mental  o-algebra  in  this  chapter  is  the  augmented  a-algebra  on  the 
space  of  continuous  functions  that  take  values  in  g{n+m.  We  denote  it 

by 

3t  =  B(Bu,Bu,  s  <  u  <  t)  =  B(Bu,  s<u<t)@S(Bu,  s  <  u  <  t) 

(k.9) 

where  =  means  equality  up  to  sets  of  measure  zero.  Our  fundamental 

measure  P  then  will  be  a  measure  on  this  space  of  continuous  functions 

C  [s.t].  We  define  the  following  measures.  Let  (j_.  be  the  measure 
n+ra  a 

on  the  space  Cnfs,l]  induced  by  the  solution  of 

dxt  =  a(t,xt)  dt  +  b(t,xt)  dBt  (4.1) 

Let  be  the  measure  induced  on  the  space  Cn[s,l]  by  the  solution  of 


dxt  =  b(t,xt)  dBt 


(4.10) 
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Let  the  measure  on  the  space  Cm[s,l]  induced  by  the  solution 

of 


dy(t,co)  =  h(t,y(t,co))  dB(t,o)) 


(4.11) 


Let  be  the  measure  on  the  space  ^^^8,1]  induced  by  the  solution 

of 


dx^  =  a(t,xt)  dt  +  b(t,xt)  dB^ 
dyt  =  g(t,xt,yt)  dt  +  h(t,yt)  dBt 


(4.1) 

(4.2) 


We  also  define  the  real- valued  functions  cp^  and  ^  using  Girsanov's 
theorem  (Theorem  1.3) 

“  t 


<PtUu,  8  <  u  <  t)  =  exp 


/«T(u,xu)c-1(u,xii)  dxu 


V/ 

2  J aT(u,xu)c'1(u,xu)a(u,xu)  du 


(4.12) 


'M  w  8  < u  < t)  =  exp 


/■ 


6  (u/Xu,yu)f_  (u,yu)  dyu 


U 

-  \  /gT(u,xu,yu)f_1(u,yu)g(u,xu,yu)  du 


(4.8) 


where 
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vn  'vnr  \rn  u-v  tnr  tm  \nrwf  rwesafti  \JM  w  y/vvtvvV'  LV\^A^TVl.\riATJVWAJVlRnAAJWAfL^VV\?Vl3V*i 


LmiJCIULRUZ 


LwuuiiujJuiuLiian  xnu 


cp.  = 


dpv 


and 


<Pi* 


lyl 


d|iXxY 
d(px  x  py) 


By  the  martingale  property  of  the  density  function  (Lemma  3.5 )  we  can 


write  for  A  e  8(xu,  s 

<  u  <  t) 

Mx(A) 

it 

=  E  [IaE 

px  A  Px 

II 

and  for  r  e  B(x  ,y  , 

'  u^u* 

s  <  u  <  t) 

tJXxY^1'^ 

II 

W 

• — i 

pX 


=  E[lrE[cp1^1|B(xu,yu,  s  <  u  <  t)]] 
=  «Wt]  =  /V t  d(pX  X  PY} 


(4.13) 


(4.14) 


For  notational  simplicity  we  have  not  explicitly  indicated  the  initial 
conditions  x(s)  and  y(s).  Our  basic  probability  space  fi  will  be 


75 


SEL-67-035 


induced  from  the  independent  Brownian  motions  (B,  }  and  { B  )  and  be  on 

"C  u 

Cn+ra[s,l]*  Since  all  of  our  random  functions  depend  only  on 
Bt,Bt,xi.,yt(t  e  [s,l])  it  will  suffice  for  cur  fundamental  measure  P 
to  consider  pY  x  p  . 

1.  An  Expression  for  the  Conditional  Probability  Measure 

We  first  discuss  the  conditional  probability  measure  in  function 
space.  The  existence  of  this  conditional  probability  measure  follows 
from  the  usual  arguments  of  conditional  expectation,  i.e.,  via  the  Radon- 
Nikodym  theorem.  We  now  derive  an  expression  for  the  conditional  proba¬ 
bility. 

Lemma  4.1.  The  conditional  probability  measure  in  function  space  for 
all  t  e  T  =  [s,l]  is  given  by 


P(A,t|a,s,yu,  s  <  u  <  t) 


E 

?X 


[IM' 


(4.15) 


where  A  e  B(xt). 


Proof. 

Fix  t  e  [s,l].  Let  0,  and  U  be  the  empty  set  and  the  whole 

T>  X 

space  in  C  [s.t],  Define  the  a-algebra  §.  on  C  [s.l]  as 
n  t  n+m 

8t  =  ©B(yu,  8  <  u  <  t)  (4.16) 


Let 

■  ; 

HjS,.  =  s(yu,  s  <  u  <  t)  (4.17) 
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| 


which 


is  a  cr-algebra  on  C  [s,l3.  We  have  for  Teg. 

HI  b 


Pp(A,t|a,s)  =  j IA(xt)  dp^  =  J  P(A,t|a,a,gt)  dp^ 
r  r 

=  / V^K^t  d(px  x  py^  =  /  d(px  x  py^ 

r  r 

(4.18) 

We  have 


E[P(A,t|a,s,§t)cpt^t|gt]  =  E[lAcpti|ft|§t]  a.s.  (4.19) 

P(A,t|a,s,§t)E[<pttt|§t]  =  E[lAcpt\|rt|gt]  a.s.  (4.20) 

The  last  equation  follows  since  P(A,t|  a,  s,§t )  is  a  measurable 

function.  We  now  consider  the  product  measure  px  x  and  take  iterated 
integrals  using  Tonelli's  theorem.  Since  both  sides  of  Eq,  (4,20)  are 
zero  for  the  integral  on  0t,  we  have  only  the  integral  on  and  for 
the  R.H.S.  of  Eq.  (4.20)  it  is 


/EPItWrtlIW  dpX  -  EfWtlSt  - 

We  consider  the  variable  of  integration  on  pY  as  x  ,  s  <  u  <  t.  So 
for  a  fixed  value  of  this  variable  the  product  I.cp.  is  a  constant  and 

At 

we  have 


-  wyniVt1 


-  Wt 
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a*s.  (4.22) 
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The  last  equality  follows  since  ^  is  a  density  function  and  there¬ 
fore  measurable  with  respect  to  Il^g^.  Since  cp^  and  i|r  are  continuous 
in  {x  ,  s  <  u  <  t)  and  I  can  be  approximated  in  measure  by  continuous 

1 V 

functions  we  need  only  consider  polynomials  with  rational  coefficients 
on  [s;t]»  So  we  only  have  a  countable  number  of  values  for  the  process 
{x^)  and  since  the  uniform  integrability  condition  can  be  easily  verified 
for  these  functions  we  therefore  have 


(4.23) 


Therefore 


p(A,t|o!,  s,rLygj_) 


E 

PX 


w 


E 

PX 


WtV 


a.s. 


(4.24) 


This  was  done  for  fixed  t.  Since  the  product  q>  ^  can  be  represented 
by  a  stochastic  integral  (cf,  Eq,  (l,22))  it  is  continuous  in  t  and 
of  course  the  sample  paths  are  continuous.  Using  the  above  result  on 
a  dense  T  set  we  can  take  a  limit  and  easily  verify  uniform  integra¬ 
bility. 

Therefore  we  can  obtain  the  result  for  all  t  e  T 


P(A,t|a,s,yu,  s  <  u  <  t) 


VWt1 

WtJ 


a.s. 


(4.25) 

I 
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2.  An  Expression  for  the  Conditional  Probability  Density 

In  Chapter  2  we  proved  that  the  process  {x^}  has  a  transition 
density  with  respect  to  Lebesgue  measure  and  that  it  could  be  represented 
as  the  fundamental  solution  of  Kolmogorov's  equations.  To  prove  that  the 
conditional,  density  exists  we  necessarily  use  the  existence  of  the  tran¬ 
sition  density  for  the  process  [x^).  The  following  representation  for 
the  conditional  probability  density  has  been  obtained  by  others.  Bucy 
[Ref.  7]  obtained  it  without  including  a  proof  (assuming  that  the  tran¬ 
sition  density  existed)  and  Mortensen  [Ref.  8]  obtained  it  under  more 
restrictive  assumptions. 


Lemma  4.2.  Let  p^  be  the  transition  density  corresponding  to  the 

process  [x^).  The  conditional  probability  density  with  respect  to 
Lebesgue  measure  exists  and  is  given  by  the  following  equation 

E  [ftlxt  = 

P(x,t|a,s,y  ,  s  <  u  <  t)  =  - ?  rr  1 -  (4.26) 

•YV 

where  t  €  (s,l). 


Proof. 


Fix  t  e  ( s, 1 ] .  Let  A  e  S(xt). 

VWJ  -  yvti  - 


fh(z ^ 


(4.27) 
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The  last  integral  reduces  to  an  integral  over  &n  since  the  integrand 
depends  only  on  x^,  So  we  have  the  measure  Px(s,a;t,dx)  induced  from 

We  therefore  have 

E JVt^  =  J'ia(x)Em  ^tlxt  =  x]Px(s,a;t,dx)  (U^. 28) 

n 

£R 

Since  is  absolutely  continuous  with  respect  to  Lebesgue  measure  we 

have 


E  [l^]  =  JlA(x)E [\|ft|  xt  =  x]px(s,a;t,x)  dx  (4.29) 

n 

JR 

Since  this  was  done  for  arbitrary  A  e  B(xt)  by  the  Radon-Nikodym  theorem 
we  have 

E  [*^1^  =  x^s>a;t^x) 

Px(x,t|a,s,yu,  s  <  u  <  t)  =  - - — -  a.e.  dx 

he  1  (4.30) 

The  above  result  was  obtained  for  fixed  t.  It  follows  easily  that  the 

result  is  true  for  a  countable  dense  T  set,  say  S.  For  arbitrary 

t  e  T  3  sequence  (t  )  with  t  -►  t  and  t  e  S.  Let  A  =  fx,  <  a). 

M  '  a  n  n  a  1  t  J 

For  sets  of  this  form,  A  ,  using  the  continuity  of  the  sample  paths 

s 

(x. )  and  the  uniform  integrability  of  the  sequence  (p  )  (corresponding 

T>  H 

to  tn)  we  can  establish  the  result.  For  an  arbitrary  set  A  e  B(x^) 

we  can  approximate  by  sets  of  the  form  A  •  Therefore  we  have  the  result 

6 

for  all  t  e  (s,lj.  | 
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3.  A  Stochastic  Equation  for  the  Conditional  Probability  Densit 


We  shall  now  proceed  to  derive  a  stochastic  equation  for  the 
evolution  in  time  of  the  conditional  probability  density.  To  obtain  this 
equation  we  first  apply  the  stochastic  differential  rule  to  f  in  the 
function  E  [\|fj  x^  =  x]  and  obtain  a  Fubini-type  result  for  an  ordinary 
and  a  stochastic  integral. 


Lemma  4.3.  For  the  function 


E  [i|r J  x,  =x]  =  E  1  +  f  gTf_1  dy  I  x,  =  x  (4.31) 

LL,  Tt'  t  LL  J  U°U  U  ’'u1  t  '  °  ' 


in  the  conditional  probability  density,  the  following  result  is  valid 


E  f  \ |r  gTf  dy  I  x.  =  x 

LL,  y  Tu°u  u  ■'u1  t 


[  E  [f  gTf  1|  x  =  x]  dy  (4.32) 
J ^  uDu  u  1  t  •'u 


where  g^  and  f  correspond  to  g(u,x(u,o)),y(u,o)))  and 
f  1(u,y(u,co))  respectively. 


Proof, 


fljj  =  (co  :  sup  |  xt|  <  M,  sup  |  yt|  <  M) 

s  <  t  <  1  s  <  t  <  1 


(4.33) 


Since  {x^}  and  (y^)  have  continuous  sample  paths 


81 


SEL-67-035 


1 


(4.34) 


lim  P (n  ) 

M  -  00 


The  last  equality  follows  since  ^  n^.  Let  A  e  S(x^.).  By  the 

boundedness  of  the  integrand  on  we  can  define  the  stochastic  integral 

as  a  limit  of  step  function  approximations  and  the  interchange  of  order 
of  integrations  is  clearly  valid  for  step  functions  since  we  are  given 
B(yu,  s  <  u  <  t).  Therefore  we  have 

t  t 

/  /+ueufulay Ud“x  -  /  /  dyu  a-8-  <4‘35) 

atBm  8  8  Ana, , 


Recalling  that  the  stochastic  integral  is  -  1  we  can  take  the  following 


limit  and  have  the  desired  equality 

t  t 

f 

M  -*  00 


lim  /  /  V ufuldyudwX  ■  //VuC  dyu  d^  a-8-  Py  <4-36) 


ArtlM  8 


A  s 


We  therefore  have 


llm  /  /Vu^1  dyu  dPx  ■ 


M  -*  oo 


A OfiM  s 


M 


lim  /  /  V&u1  aiix  ayu  a...  py 

(4.37) 


s  Ann 


M 


Recall  that 


sup  E  (xj  < 

s  <  t  <  1  h>x! 


sup  Ell,  [vtl 

<  t  <  1  ^XxyL  t 


<  00 
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and  f  >  k  >  0,  and  g  is  globally  Lipschitz.  By  Fubini's  theorem  and 
the  Dominated  Convergence  theorem  it  follows  that 


lim 
M  -*  00 


/ 


t  gV1 

Tu°u  u 


ATM 


M 


/v^1^  s-s-  ^ 

A 


(4.38) 


where  we  use  the  continuity  in  t  of  the  integrand  and  of  the  sample 
paths. 

Let 


fM  *  /  V^1  ^ 

AH^m 


(4.39) 


The  sequence 


f 


lim 
M  -*  00 


M 


/fMdys'  /fdy .  M=1>2—. 


(4.40) 


is  a  martingale  (w.r.t.  8(yu,  8  5  u  5  *))  and  using  the  martingale 
convergence  theorem  (Theorem  3*6)  we  have 


,lln  /fMdyS  -  /fdy  8 


Therefore 


Vi  V 

//+  u^ldyudMX  -  /  f^X1  d“x  dyu  °-s-  M, 


A  s 


s  A 


(4.41) 


(4.42) 


This  was  done  for  fixed  t,  but  using  the  continuity  in  t  of  the 
stochastic  integral  we  can  obtain  the  result  for  all  t  €  T.  I 
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We  will  now  derive  a  stochastic  equation  for  the  numerator  of  the 
conditional  probability  density  and  subsequently  a  stochastic  differential 
equation  for  the  conditional  probability  density. 

Define  the  function  r  as  follows 


r(x,t|a,s,yu,  s  <  u  <  t)  =  E  xt  =  x]p(s,ajt,x)  (4.43) 

A 

Lemma  4,4,  For  all  t  e  (s,l]  a  version  of  r  is  given  by  the  following 
stochastic  equation 

r(x,t|a,s,yu,  s  <  u  <  t)  =  px(s,a;t,x) 
t 

+  // Px(u,x/;t,x)gT(u,x',yJf”1(u,yu)r^x/,u|o(,s,yv,  s  <  v  <  u)  dx'  dyu 
s  n 

a  (4.44) 


Proof  (cf.  Mortensen,  Ref.  8). 

From  the  previous  lemma  (Lemma  4,3) 


'  t 

t 

. 

E 

fi  gTf_1  dy  |x 

J  Tu°u  u  ‘'u'  t 

_s 

V - *  CD 

II 

^  gV1!  x 
Wu  1  t 

dy,. 


(4.45) 


Using  this  result  and  the  st~-hastic  differential  rule  for  (cf, 
Eq.  (1.22))  we  have 


x] 


(4.46) 


We  will  now  give  a  characterization  for  the  integrand  of  the  above  stochastic 


integral,  i.e., 


(4.47) 


Since  we  are  given  B(yu,  s  <  u  <  t) 


(4.48) 

Since  is  independent  of  x^  t  >  u  ((^u>xu>yu)  is  a  Markov  process) 

we  have  for  the  R.H.S. 


(4.49) 


Multiply  Eq,  (4.49)  by  p(s,ajt,x)  and  use  Eq.  (4.46)  which  gives  the 
result.  To  establish  the  result  for  all  t  €  (s,l]  we  note  the  continuity 
in  t  of  p^  and  of  the  stochastic  integral.  | 

We  shall  now  derive  a  differential  expression  for  r.  If  we  formally 
take  the  differential  of  the  integral  equation  for  r  (Eq.  4.44)  we  have 
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dr(x,t|a,s,yu,  s  <  u  <  t)  =  dpx(s,ajt,x)  +  gT(t,x,yt )f-1(t,yt)  dyt 
t 

+  J  J dpx(u,x'jt,x)gT(u,x%yu)f_1(u,yu)r(x/>u|a,s,yv,  s<v  <u)  dx'  dyu 


8<Rn 


For  the  differential  of  the  double  integral  we  would  expect  to  obtain 


gT(t,x,yt)f_1(t,yt)  dyt 


+  / /dPx(u^x^t>x)sT(u>x%yu)f":L(u^yu)r(x%ul^s>v  s<v<u) dx'  dyu 


S  n 

a 


Clearly  the  only  difficulty  we  have  is  in  interchanging  the  integral  and 
differential  operations  in  the  last  term. 

To  justify  this  last  result  we  first  note  that 


E[cpttt]  =  1 


Thus  by  Fubini's  theorem  we  can  conclude  that 


E  0+  ]  <»  Vt  a.s.  m, 
**X  *  ^ 


Note  also  that  f  is  strictly  positive  definite  and  that 


E 

<  t  <  1  ^XxyL  t 


Since  the  function  r  is,  except  for  a  normalizing  constant,  a  conditional 
probability,  the  stochastic  integral 
t 

f  j  g^f"lr(x',u|a,s,yv,  s  <  v  <  u)  dx'  dyy 
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is  well  defined  and  can  be  defined  as  the  limit  of  step  function  approxi¬ 
mations,  Since  the  terms  of  dp^  are  bounded  (cf,  the  proof  of  Lemma  2.4) 
we  use  the  step  function  approximations  together  with  the  Bounded  Convergence 
theorem  to  conclude 
t 

d/  / ^x'it^jg^^yjf-^yu^x'^^s^^  s  <  v  <  u )  dx'  dyy 

s  n 
<R 

=  gT(t,x,yt)f-1(t,yt)  dyt 
t 

+  // ^u,x/;t,x)gT(u,x/,yu)f"1(u,yu)r(x/,u|a,s,ys,  s  <  v  <  u)  dx'  dyy 
s  n 

K  (4.50) 

In  the  differential  expression  for  r  we  can  write  the  terms  of  dpx 
as  functions  of  r  and  its  derivatives  by  using  the  integral  equation 
for  r  (Eq.  4.44)  and  applying  the  techniques  used  to  prove  Eq.  (4.50) 
to  interchange  the  partial  derivatives,  that  is,  we  obtain 
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n  s2(c, ,(t,x)r) 


1  ST  w  ^i,1 

2  Zj  dx.dx4 

J  J  T  •*■ 


±,1=1 


2 

lva  (^^(t^xJ^s^ajt^)) 
2  Zj  dx.,  dXj 


./  jjii'(,“1,a(-''i,j>) 

s  n  J 

(R 

f_1(u,yu)r(x%u|a,s,yv,  s  <  v  <  u)  dx'  dyy 


We  therefore  obtain 


,  /l  V  d2(e  (t,x)r) 

dr(x,t|a,s,yu,  s  <  u  <  t)  =  U  ^  . 3xT5xV 

\  i,J-l  J 

3,  3(ai(t,x)r)\ 

■  2  — — J 

1=1  1  / 


dt  +  gT(t,x,y  )f_1(t,y  )r  dy  (4.51) 


We  now  consider  the  denominator  term  in  the  expression  for  the  con¬ 
ditional  probability  density.  By  our  result  for  interchanging  expectation 
and  stochastic  integral  (Lemma  4.3)  and  by  the  continuity  of  the  sample 
paths  we  have 


[*tl 


(4.52) 


Let 


V**1 

(4.53) 

r(x,t|a,s,yu,  s  <  u  <  t) 

(4.54) 
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With  this  equation  we  therefore  have  in  principle  the  solution  of  a 
fairly  general  nonlinear  filtering  problem.  This  result  is  analogous  to 
the  expressions  obtained  by  Bucy  [Ref.  7],  Kushner  [Ref.  5 ] ,  Mortensen 
[Ref.  8]  and  Shiryaev  [Ref.  42], 

C.  CONDITIONAL  MOMENTS 

For  some  problems  in  filtering  theory  the  diffusion  matrix,  b,  for 
the  state  Markov  process  (Eq.  4.1)  does  not  have  an  inverse  ard  the 
conditional  probability  density  may  not  exist  because  the  transition 
density,  p„,  may  not  exist.  For  such  problems  we  can  obtain  a  stochastic 
equation  for  the  conditional  moments  and  more  generally  for  smooth 
functions  of  the  process  (x+ } • 

We  state  our  result  in  the  following  theorem. 

Theorem  4.2.  Let  {x^ }  and  (y^)  satisfy 

dx(t,(jo)  =  a(t,x(t,cu) )  dt  +  b(t,x(t,co))  dB(t,cn)  (4.6l) 

dy(t,oo)  =  g(t,x(t,cu),y(t,cjo))  dt  +  h(t,y(t,o>))  dB(t,cn)  (4.62) 

where  x  =  a,  y  =  0,  t  e  [s,l],  [B,  )  and  [B,  }  are  independent 
Brownian  motions  in  <xn  and  respectively  and  the  drift  vector 

a(t,x)  and  the  diffusion  matrix  b(t,x)  are  continuous  in  t  and 
globally  Lipschitz  continuous  in  x,  the  drift  vector  g(t,x,y)  is 
continuous  in  t  and  globally  Lipschitz  continuous  in  x  and  y 
and  the  diffusion  matrix  h(t,y)  is  continuous  in  t  and  globally 
Lipschitz  continuous  in  y  and  the  symmetric  matrix  f  ^f  =  la"hj  is 
strictly  positive  definite. 
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Let  y  be  a  real-valued  twice  continuously  differentiable  function 


defined  on  £Rn 


such  that 


// |r(xt)|2  dP  dt  <  »  (4.63) 

T  ft 


JJl  xtr'(xt)|  2  dP  dt  <  oo  (4.64) 

t  n 


jj\\r"(xt)\  dP  dt  <  oo  (4.65) 

T  Q. 


where  the  prime  denotes  differentiation.  Then  the  conditional 
expectation  of  y,  E[y(xt)|a, s,yu,  s  <  u  <  t],  denoted  as  y^  satisfies 

dyt  =  £r(xt)  dt 

+  (r(xt)g(t,xt,yt)  -  y(xt)g(t,xt,yt))Tf^1(dyt  -  g(t,xt,yt)  dt)  (4.67) 
where  for  example, 


(4.68) 


(4.69) 


\|/t  is  given  by  Eq.  (4.8). 
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Proof 


By  our  results  for  the  conditional  probability  (Lemma  4.1)  we  have 


E[r(x .  )|a,s,y  ,  s  <  u  <  tj  = 


e  [r(xt)*t) 


yv 


(4.70) 


As  in  our  derivation  of  the  conditional  probability  density  we  first 


consider  the  differential  of  the  numerator  of  the  R.H.S.  of  the  above 


equation.  We  apply  the  stochastic  differential  rule  to  y(x,  )\|r  to 


obtain 


r(x,  )t,  -  r(x  )\|r  =  r(x  )gTf  1  dy  +  f  £f(x  )\y  du 

'  t7  t  v  s7  s  J  u  '  u7°u  u  17 u  J  u7  u 


+  f  \ ]/  r'(*  )b  dB 
J  u'  v  u7  u  u 


(^.71) 


With  our  assumption  that 


J  J  |xtr'(xt)l2  dp  dt  < 


and  the  fact  that  is  a  density  we  have  for  almost  all  y  ,  s  <  u  <  t 

u  u7  —  — 


E  f i  Y'(x  )b  dB  =  0 

Hy  J  u’  u7  u  u 


(4.72) 


We  have  only  to  prove  the  following 
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mmmmm 


ur 


9 


t 

=  /k  flr(xu)*udu  (4.73) 

s 

t 

=  [  E  *  y(x  )gTf_1  dy  (4.74) 

J  (iy.  u  v  u/Du  U  •'u  '  ' 

The  first  equality  (Eq.  4,73)  follows  directly  from  Fubini's  theorem 
with  the  integrability  assumptions  made.  The  second  result  is  more 
difficult  but  the  proof  is  quite  similar  to  the  proof  of  Lemma  4.3*  We 
state  the  result  in  the  following  lemma. 

Lemma  4.5.  The  following  interchange  of  order  of  integrations  is  valid 

s* 

// dyu  d^  -  //  dl*x  dyu  (4-75) 

ft  s  s  ft 

Proof. 

Let 


E 


“x 


du 


E  f  i  r(x  )gTf  1  dy 
J  ru*  N  u/Du  u  •'u 


to  obtain  our  result. 


nM  =  {cd 


sup 

s  <  t  <  1 


|  x ,  |  <  M 


sup 

s  <  t  <  1 


<  M} 


(4.76) 


Since  the  processes  (x^)  end 


(yt)  have  continuous  sample  paths  we  have 


1  =  Urn  p(aM) 
M  -*■  00 


(4.77) 
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The  last  equality  follows  since  ^M+1  D  ft^.  By  the  boundedness  of  the 


integrand  on  ft  we  can  define  the  stochastic  integral  as  a  limit  of 


step  function  approximations  on  this  set.  The  interchange  of  order  of 


integrations  is  clearly  valid  for  step  functions  since  we  are  given 


B(yu,  s  <  u  <  t).  Therefore  we  have 


*fc  ^ 

J/'AKV  dyu  ^  =  //v(x U^U1  ^  dyU  (k-78> 


ft* »  S 

M 


Since  y  (x^)  is  assumed  square  integrable  on  the  product  measure  du  x  dji^ 


and  the  other  terms  correspond  to  the  density  function  we  have 


urn  //  ayu  =  f  f  i,ur(xu)B7f-1  ay^  a^  (4.79) 


Similarly  we  can  show 


lim 
M  -*  co 


/V(V fin1  ^  <4-80) 


We  can  new  obtain  the  following  equality 


Urn  I/V^1  dyu  .  Um  /  f  ^  dyu 

""  J  J  M  ->  00 


M  ->  00 


(4.81) 


since  the  limit  on  the  L.H.S.  is  well  defined. 


By  the  uniform  integrability  of  the  sequence  (f^) 
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(4.82) 


f  =  [  y*(x  )gTf  1  d|j_^ 
M  J  u'  '  u/eu  u  TC 

a.. 

M 

we  have 

t 

Urn  /  /  %L  3jru 

M-°os  aR 


Therefore  we  have 

t  t 

/  %  =  //V^XC  dyu  I  (4.84) 

s  o,  n  s 


Recall  Eq.  (4.56)  where  we  have  already  calculated  the  differential 


u 

-  /Mlim  /  V^u^u1  ^  dyu 

e  M  00  n 


Si 


(4.83) 


for 


1 


E 


Combining  this  differential  with  our  differential  result  for  the  numerator 

term  E  [Wx,  )f.]  we  have 
My  t/Tt 


drt  =  ar(xt)  dt 


+  (r(xt)g(t,xt,yt)  -  r(xt)g(t,xt,yt))Tf^1(dyt  -  g(t,xt,yt)  dt)  (4.85) 


where  for  example, 
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jumwuuu! 


tw 


r(x+)  = 


yv 


(4.86) 


This  completes  the  proof  of  the  theorem.  | 
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V.  EVALUATION  OF  LIKELIHOOD  FUNCTIONS 


Some  results  for  the  detection  of  a  stochastic  signal  in  white 
Gaussian  noise  have  been  obtained  where  the  likelihood  function  (Radon- 
Nikodym  derivative)  could  be  calculated  recursively  from  a  differential 
equation.  The  terms  of  this  differential  equation  were  related  to  quantities 
that  arise  in  filtering  problems.  Schweppe  [Ref.  15 ]  considered  the 
detection  problem  where  the  signal  was  generated  by  white  noise  into  a 
finite  dimensional  linear  system  and  formally  showed  the  relation  of  a 
differential  equation  for  the  likelihood  function  to  the  linear  filtering 
results  of  Kalman  and  Bucy.  Sosulin  and  Stratonovich  [Ref.  17 ]  considered 
the  detection  problem  where  the  signal  was  a  diffusion  process  and  formally 
related  a  differential  equation  for  the  likelihood  function  to  the  non¬ 
linear  filtering  problem. 

In  this  chapter  we  shall  rigorously  derive  a  stochastic  differential 
equation  for  the  likelihood  function  of  a  stochastic  signal  (diffusion 
process)  in  white  Gaussian  noise  and  relate  this  to  the  results  of  Schweppe 
and  Sosulin  and  Stratonovich.  We  shall  also  discuss  detection  problems  of 
a  stochastic  signal  (diffusion  process)  in  correlated  noise  (diffusion 
process)  obtaining,  for  some  problems,  necessary  and  sufficient  conditions 
for  nonsingular  detection.  For  the  nonsingular  case  we  derive  a  differ¬ 
ential  equation  for  the  evolution  of  the  likelihood  function  by  relating 
the  detection  problem  to  a  detection  problem  with  white  noise . 

A.  A  DIFFUSION  FROCESS  IN  WHITE  NOISE 

We  consider  the  two  hypotheses  detection  problem  of  a  stochastic 
signal  (diffusion  process)  in  white  Gaussian  noise  described  by  the  following 
stochastic  differential  equations 
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IMRUM! 


dy^  =  H(t)xt  dt  +  dB^  for  0=1 

(5.1) 

=  dB^  for  0=0 

where 

dx  =  a(t,x  )  dt  +  b(t,x  )  dB  (5.2) 

X  X  X  x 

and  t  e  [s,l],  We  furthermore  assume 

j(.  The  'initial  conditions  are  x(s)  =  a,  y(s)  =  0  and  x^  is  an 

n  vector,  y  is  an  m  vector,  H(t)  is  an  m  x  n  matrix  continuous 

X 

in  t  and  B.  and  B,  are  independent  n  and  m  dimensional  Brownian 

X  X 

motions  respectively.  The  drift  vector  a(t,x)  and  the  diffusion 
matrix  b(t,x)  are  continuous  in  t  and  globally  Lipschitz  continuous 
in  x.  The  prior  probabilities  are  P(0  =  l)  =  JL^  and  P(0  =  0)  =  IIQ, 

1.  A  Differential  Equation  for  the  Likelihood  Function 

We  define  the  following  measures  as  we  did  for  the  nonlinear 
filtering  problem.  The  measure  is  the  measure  induced  on  the  space 

Cn[s,l]  by  the  solution  of 

dx(t,co)  =  a(t,x(t,<n))  dt  +  b(t,x(t,co))  dB(t,o>)  (5.2) 

where  t  e  [s,l]  and  x(s)  =  a.  The  measure  is  the  Wiener  measure 

induced  on  C  [s,l]  by  the  solution  of 
m  ’ 

<3y(t,<n)  =  dB(t,cu)  (5.3) 
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where  t  e  [s,l]  and  y(s)  =  0.  The  measure 


is  the  measure  induced 


on  the  space  Cn+m[s,l]  by  the  solutions  of 


dx(t,co)  =  a(t,x(t,oi))  dt  +  b(t,x(t,cjo))  dB(t,o) 


(5.2) 


dy(t,oj)  =  H(t)x(t,o>)  dt  +  dB(t,a>) 


(5.4) 


where  t  e  [s,l],  x(s)  =  a  and  y(s)  =  0. 
We  define  the  function  i|r,  as 

t 


t.(x .  ,y. 1  ,  s  <  u  <  t)  =  exp  f x^HT  dy  -  ^  [  x^H^H  x  du 

t'  u^u'  —  —  '  *  J  u  u  •'u  2  J  u  u  u  u 

_s  s 


(5*5) 


where 


dMXxY 
^(Mx  x  pY) 


(5.6) 


We  now  derive  an  expression  for  the  likelihood  function  for  the 
detection  problem  (Eq.  5.1). 

Lemma  3.1.  The  likelihood  function,  A^,  for  the  detection  problem, 
Eq.  (5.1),  where  we  assume  X  is  given  by 

At  -  yn1 

where  y  is  given  by  Eq.  (5.5). 


(5.7) 


Proof, 


The  likelihood  function,  A  ,  is  the  Radon-Nikodym  derivative  of 
the  measures,  say  p1  and  pQ,  corresponding  to  the  two  hypotheses 


0=1  and  0=0,  i.e., 


t  -  dp. 


(5-8) 


where  the  measures  are  functionals  of  the  sample  paths  to  time  t.  Let 


r  e  B(y  ,  s  <  u  <  t).  Then 


Pi(r)  =  /  /*t  x  po' 


=  /  E^Ut]  dpQ 


(5.9) 


By  definition  of  the  Radon-Nikodym  derivative  we  have 


A»  -  \l*t]  ' 


(5.10) 


With  an  expression  for  the  likelihood  function  we  are  able  to  derive 


a  stochastic  equation  for  a  monotonic  function  of  the  likelihood  function. 


Theorem  5.1.  Consider  the  two  hypotheses  detection  problem 


dyt  =  H(t)xt  dt  +  dBt  for  0=1 


(5.1) 


dB  for  0  =  0 

u 


where  we  assume  Let  A  be  the  likelihood  function  for  this 


detection  problem. 


Then  the  process  (z^)  defined  as 


Zt  =  ln  At 


(5.11) 
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satisfies  the  following  stochastic  differential  equation 


aTttT  ,  1  aT„T„  a  ,, 

dzt  -  XA  dyt  '  2  xtHtHt*t  dt 


(5.12) 


where 


A  VfVt] 

Xt  “  E  L\|f.J 


(5.13) 


is  the  conditional  mean  of  x  given  {y  ,  s  <  u  <  t)  (cf.  Eq.  4.67). 


Proof. 


We  apply  the  stochastic  differential  rule  (Theorem  1.2)  to 


In  At  (5.11) 

9 

i  (dAt)2  (5.14) 

'  2  ~2 
At 

2 

The  terms  dA^  and  (dA^.)  have  been  calculated  in  an  example  of  the 
stochastic  differential  rule  in  Chapter  1  (Eq.  1.27)  and  are 

-  \[VtHt]  dyt 

(■v2  =  iJvKjyw.11' 

Therefore  we  have 

dzt  =  XtHt  dyt  ■  2  XtHtHtXt  dt  (5.12) 


(5.15) 

(5.16) 


and  obtain 


dzA 
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where 


A 


■yvt1 

"%[nr 


(5.13) 


2.  Comparison  With  Previous  Results 

The  stochastic  differential  equation  for  {z^}  (Eq.  5.12)  is 
different  in  appearance  from  the  equation 


1 

2 


x^Htxt 


dt 


(5. IT) 


where 


m  m 

Wtxt 


E 


E 


(5.18) 


obtained  by  Schweppe  [Ref.  15 ]  and  Sosulin  and  Stratonovich  [Ref,  17], 

This  anomaly  between  the  two  equations  for  the  likelihood  function  occurs 
because  of  the  different  definitions  of  stochastic  integral  and  the 
convergence  properties  of  discrete  time  versions  of  a  stochastic  equation 
[Refs.  9,^ 3, 44, 45 ] .  In  Eq.  (5,17),  the  "correlator"  term  (stochastic 
integral)  has  to  be  interpreted  in  the  sense  of  Stratonovich  [Ref.  9] 
while  in  our  equation  (Eq.  5.12)  the  stochastic  integral  has  the  K.  Ito 
interpretation. 

To  clarify  the  relation  between  these  two  results  we  will  indicate 
the  correction  term.  If  we  perform  an  integration  by  parts  on  the  stochastic 
integral 
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(5.19) 


-4. 

/ 


A'iu T 
XtHt 


dy+ 


(this  integration  by  parts  is  valid  since  this  stochastic  integral  can  be 
defined  as  the  limit  of  step  function  approximations,  x^  has  a  differ¬ 
ential  given  by  Eq.  (5.24),  and  we  assume  dH/dt  exists  and  is  continuous) 
then  the  stochastic  integral  we  obtain  is 

1 

•/  ytHt  dxt  (5.20) 

s 

We  shall  consider  the  case  of  scalar  observations  (m  =  1),  and  compute 
the  correction  terra  first  for  the  Gaussian  case. 

Consider  the  K.  Ito  stochastic  integral 

f*( t,yt)  dyt  (5.21) 


where 


dyt  =  g(t,yt)  dt  +  dit 


Then  if  we  aad  the  term  (cf.  Ref,  9) 


2  J  5y 


dt 


(5.22)  ‘ 


(5.23) 


to  the  stochastic  integral  we  have  the  integral  described  by  Stratonovich. 

Recalling  the  stochastic  differential  equation  for  x^^,  a  component 
of  ;t 
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(5.24) 


JSx. 


(i) 


dt  + 


y^H.x 

it  t  t 


and  that  in  the  linear  case  [Ref.  l]  the  function 


HtXt 


(5.25) 


depends  only  on  t,  the  correction  terra  which  we  must  add  to  our  differ¬ 
ential  equation  is 


-If  (4 


xtHtHt 


xt) 


dt 


(5.26) 


which  gives  Schweppe’s  result. 

To  relate  our  result  to  the  equation  obtained  by  Sosulin  and  Stratonovich 
we  heuristically  describe  a  "generalized"  Stratonovich  integral  motivated 
by  the  fact  that  we  want  the  rules  of  transformation  of  ordinary  calculus 
to  apply  to  this  integral.  We  use  a  result  of  K.  Ito  [Ref.  30]  for  the 
product  of  stochastic  integrals 

v  v  v  t 

J  £(t,oo)  dB(t,(n)  f  T)( s,cn)  dB(s,oo)  =  J  £(t,o>)  J  t](s,cd)  dB(s,cn)  dB(t,co) 
u  u  u  u 

VS  V 

+  f  r)(s ,oj)  J  £(t,oo)  dB(t,o>)  dB(s,cs)  +  J  ^(t,oo)r](t,co)  dt  ( 5 •  27 ) 

u  u  u 


whereas  if  these  were  ordinary  integrals  we  would  not  have  the  last  terra. 
We  therefore  "split"  this  ordinary  integral  between  the  two  stochastic 
integrals  as 
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/»  V 

C(t,<o)  f  t)(b,0))  dB(s,cu)  dB(t,a>)  +  ^J  £(t,<o)ri(t,a>)  dt 


vo  V 

+  / 1(  s,o)  J  £(t,<u)  dB(t,a>)  dB(s,to)  +  J  £(t,<o)r|(t,co)  dt 


Defining  this  as  a  Stratonovich  integral  we  then  have  our  correction  term 
which  reduces  to  the  correction  term  (Eq.  5.23)  for  the  diffusion  process 
case.  This  correction  term  again  is 


- 1  /(*Xvt  -  sXhA)  at 


(5.28) 


from  Eq.  (5.24).  Therefore  with  this  term  our  results  correspond  with 
the  equation  of  Sosulin  and  Stratonovich. 

B.  A  DIFFUSION  PROCESS  IN  CORRELATED  NOISE 

Having  established  a  stochastic  differential  equation  for  the  likelihood 
function  for  the  detection  of  a  stochastic  signal  (diffusion  process)  in 
white  Gaussian  noise  the  obvious  extension  of  these  results  is  to  the 
detection  of  a  stochastic  signal  (diffusion  process)  in  correlated  noise 
(diffusion  process).  We  describe  a  problem  of  this  type  by  the  following 
stochastic  equations 


yt  =  H(t)xt  +  z  for  0  =  1 


(5.29) 


z^  for  0=0 


where  t  €  [s,l]  and 
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dx^  =  a(t,xt)  dt  +  b(t,xt)  dB^ 
dzt  =  g(t,zt)  dt  +  h(t)  dBt 

We  furthermore  assume 

H.  The  initial  conditions  are  x(s)  =  a,  z(s)  =  0  and  x  is  an 
n  vector,  7.  is  an  m  vector,  H(t)  is  an  ra  x  n  matrix  that  is 
continuous  in  t  and  B,  and  B  are  independent  n  and  m 
dimensional  Brownian  motions  respectively.  The  drift  vectors  a(t,x) 
and  g(t,x)  are  continuous  in  t  and  globally  Lipschitz  continuous 
in  x.  The  diffusion  matrix  b(t,x)  is  continuous  in  t  and  globally 
Lipschitz  continuous  in  x.  The  diffusion  matrix  h(t)  is  continuous 
in  t  and  h  1  exists.  The  prior  probabilities  are  P(e  =  l)  =  1^ 
and  P(e  =  0)  =  IIq.  The  derivative  of  H(t),  H'(t),  is  continuous  in  t. 

1.  Necessary  and  Sufficient  Conditions  for  Nonsingular  Detection 
We  shall  now  obtain  necessary  and  sufficient  conditions  for  non¬ 
singular  detection  for  the  problem  described  above  (Eq.  5.29). 

Theorem  5.2.  Consider  the  detection  problem 


(5.30) 

(5.31) 


yt  =  H(t)xt  +  z  for  6  =  1 

=  z  for  0=0 

where  t  e  [s,l]  and 


(5.29) 
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1 


dx^ 


dz. 


a(t,xt)  dt  +  b(t,xt)  dB^ 

(5.30) 

g(t,zt)  dt  +  h(t)  dBt 

(5.31) 

and  we  furthermore  assume  K.  For  this  detection  problem  to  be  non¬ 
singular  it  is  necessary  and  sufficient  that 


H(t)b(t,xt)  =  0 


(5.32) 


Proof  (Sufficiency). 

It  will  be  convenient  to  change  the  form  of  the  above  detection  problem 
by  describing  the  hypotheses  by  stochastic  differential  equations  as 

dyt  =  H(t)a(t,xt)  dt  +  H(t)b(t,xt)  dBt  +  g(t,yt  -  H(t)xt)  dt 

+  H'(t)xt  dt  +  h(t)  dBt  for  0=1  (5.33) 

=  g(t,yt)  dt  +  h(t)  dBt  for  0  =  0 

Now  let  H(t)b(t,xt)  =  0.  Then  the  two  hjpotheses  are 

dyt  =  H(t)a(t,xt)  dt  +  g(t,y  -  H(t)xt)  dt  +  h(t)  dBt  for.  0=1 

+  H'(t)xt  dt 

=  g(t,yt)  dt  +  h(t)  dBt  for  0=0 

Since  the  process  (x^.)  is  generated  by  {B^)  and  h’1  exists  we  can 
easily  modify  Girsanov's  Theorem  (Theorem  1.3)  to  show  that 


<K  “x  x  <=y 


(5.34) 


where  the  measure  pv  is  the  measure  induced  on  C  [s,l]  by  the  solution 

x  rn  7 

of 


=  g(t,yt)  dt  +  h(t)  dBt  (5.35) 

for  t  €  [s,l]  and  y(s)  =  0.  The  measure  (i^  is  the  measure  induced 
on  C^ts,!]  by  the  solution  of 


dxt  =  a(t,xt)  dt  +  b(t,xt)  dBt  (5.36) 

for  t  e  [s,l]  and  x(s)  =  a.  The  measure  1^^  is  the  measure  induced 

on  C  [s.l]  by  the  solutions  of 
n+m 

dxt  =  a(t,xt)  dt  +  b(t,xt)  dBt  (5.36) 

dyt  =  H(t)a(t,xt)  dt  +  g(t,yt  -  H(t)xt)  dt  +  h(t)  dBt  (5.37) 


+  H'(t)xt  dt 


for  t  e  [s,l] 
Define  ^ 


and  x(s)  =  a,  y(s)  =  0. 
as  the  density  function  so  that 


i  d|1XxY 

*1  “  d(Mx  x  Py) 


(5.38) 


The  form  of  this  function  ty,  can  be  determined  from  Girsanov's  theorem 
(Theorem  1.3). 

The  likelihood  function,  follows  from  Lemma  5.1  as 
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i 


At  =  (5.39) 

Proof  (Necessity). 

If  b  ^  exists  we  can  show  that  we  have  a  singular  detection  problem 
by  using  our  result  from  Chapter  3  (Theorem  3.1)  for  the  absolute  continuity 
of  measures  corresponding  to  solutions  of  stochastic  differential  equations. 

Define  the  measure  as  the  measure  induced  on  Cn[s,l]  by  the  solution 

of 

! 

dx(t,co)  =  b(t,x(t,oo))  dB(t,oi)  ( 5 .40) 

for  t  e  [s,l]  and  x(s)  =  a,  the  measure  *s  ^he  measure  induced 

on  C  [s.l]  by  the  solutions  of 
n+m 

« 

dx(t,o>)  =  b(t,x(t,o>))  dB(t,cu)  ( 5. 4o) 

dy(t,cn)  =  H(t)b(t,x(t,05))  dB(t,cu)  +  h(t)  dB(t,o))  (5.4l) 

for  t  e  [s,l]  and  x(s)  =  a,  y(s)  =  0,  and  the  measure  is  the 

measure  induced  on  C  [s.l]  by  the  solutions  of 

n+m  *  J 


dxt  =  a(t,xt)  dt  +  b(t,xt)  dBt  (5.42) 

dyt  =  H(t)a(t,xt)  dt  +  H(t)b(t,xt)  dBt  +  g(t,yt  -  H(t)xt)  dt  +  h(t)  dBt 

+  H'(t)x,  dt  (5.43) 

•  U 

The  measure  is  defined  by  Eq,  (5.35). 

By  Theorem  3.1  it  follows  that 
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PyvV  pY  X  p 


and 


^X  =  PX 


therefore 


^XxY  ^XPY 


-1 


If  b  does  not  exist  we  apply  a  result  due  to  Wong  and  Zakai  [Ref.  46] 
stated  in  the  following  lemma. 


Lemma  5.2.  Let  [x^]  satisfy 


dxt  =  0(t,xt)  dt  +  r(t,xt)  dBt 


(5.44) 


where  t  e  [s,l],  x(s)  =  a  and  0(t,x)  and  r(t,x)  are  continuous 
in  t  and  globally  Lipschitz  continuous  in  x;  x.  is  an  n  vector 

w 

and  is  n  dimensional  Brownian  motion. 


Then 


lim 
n  -»  oo 


k(n)-1  /  /  V  /  v\2  n  l 

1  (xi(t(iri)  -  xj(t(in)))  ■  5  frU'* 

i=l  '  r=l  s 


)  dt  (5.45) 


in  the  mean  where  r  =  [y.  ,). 

For  the  proof  of  this  lemma  the  reader  is  referred  to  Wong  and 
Zakai  [Ref.  46], 

Using  Eq.  (5.45)  as  our  test  statistic  on  the  observations  we  are 
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able  to  determine  if  the  signal  is  present  or  net  and  therefore  have 
singular  detection.  | 

2.  Reduction  to  a  White  Noise  Detection  Problem 

In  the  nonsingular  correlated  noise  detection  problem  we  have  for 
the  two  hypotheses 

dyt  =  H(t)a(t,xt)  dt  +  g(t,yt  -  H(t)xt)  dt  +  h(t)  dB^.  for  0=1 

+  H'(t)x^_  dt  (5.^6) 

=  g(t,yt)  dt  +  h(t)  dBt  for  0=0 


As  we  mentioned  in  the  proof  of  Theorem  5.2  an  expression  for  the  likelihood 
function  (Eq.  5.39)  can  be  calculated  using  Girsanov's  Theorem  (Theorem  1.3). 
We  shall  now  show  how  to  obtain  a  differential  equation  for  the  likelihood 
function  by  considering  the  detection  problem  as  a  white  noise  type  of 
detection  problem. 

In  the  proof  of  Theorem  5*2  we  defined  the  measures  p^.,  and 

p^y  (cf.  Eqs.  5.35,  5.36,  5.37).  We  now  define  the  measure  induced 

on  C  [s.l]  by  the  solution  of 
m 

dyt  =  h(t )  dBt  (5.^7) 

for  t  €  [s,l]  and  y(s)  =  0.  By  Girsanov's  Theorem  (Theorem  1,3)  we 
have 


Py  «  P~ 
Y 
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The  likelihood  function,  A  ,  with  respect  to  the  measure  is 

t  Y 


A 


t 


yV 


(5.M) 


where  ty,  is  determined  from  (Eq.  5*38)  and  dp  / dp  .  This  result 

t  t  i  ~ 

follows  from  the  definition  of  the  likelihood  function  (Eq.  5*8). 

We  define  z as 


\  =  lnAt  (5.^9) 

and  take  the  differential  of  z  (using  Eq.  5.14)  to  obtain  a  differential 
expression  for  z  .  We  therefore  have  a  white  noise  type  of  detection 
problem.  Since  the  details  are  straightforward  they  will  be  omitted  here, 
3.  Some  Generalizations 

We  now  consider  a  more  general  correlated  noise  detection  problem 
with  the  hypotheses 


yt  =  H(t)xt  +  G(t)zt  for  0=1 

(5.50) 

=  G(t)zt  for  0=0 

where  G  is  a  k  x  ra  matrix  continuous  in  t  and  H  is  a  k  x  n  matrix 
continuous  in  t.  The  derivatives  of  H  and  G,  H/  and  G',  are  continuous 
in  t.  We  also  assume  K.  We  shall  make  additional  assumptions  as  we 
proceed. 

For  this  correlated  noise  detection  problem  we  shall  discuss  conditions 
for  nonsingular  detection.  This  discussion  will  be  somewhat  more  informal 
than  the  discussion  in  the  above  section  because  we  primarily  want  to 
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indicate  the  methods.  We  again  convert  our  hypotheses  to  stochastic 
differential  equations 

dyt  =  H(t)a(t,xt)  dt  +  H(t)b(t,xt)  dBt  +  G(t)g(t,zt)  dt 

+  G(t)h(t)  dBt  for  0=1 

=  G(t)g(t,z  )  dt  +  G(t)h(t)  dB^.  for  0  =  0 

(5.51) 

Primarily  for  simplicity  of  discussion  we  shall  assume  that  the  observations 
are  scalar,  i.e.,  k  =  1. 

To  determine  singularity  or  nonsingularity  of  the  detection  problem 
we  shall  consider  a  few  cases.  If  Hb  ^  0  then  the  detection  problem  is 
singular  by  Lemma  5.2.  If  Hb  =  0  and  Gh  /  0  then  the  detection  problem 
is  nonsingular  by  applying  Girsanov' s  Theorem  (Theorem  1.3).  If  Hb  =  0 
and  Gh  =  0  we  have  the  hypotheses 

dy^  =  H(t)a(t.xt)  dt  +  G(t)g(t,z^)  dt  for  0=1 

=  G(t)g(t,zt)  dt  for  0=0 

Let 

dyt 

K  -  at'  (5.52) 


Then 


uu/ujuwcnrwpn 


T 


y'  =  H(t)a(t,xt)  +  G(t)g(t,zt)  for  0=1 

=  G(t)g(t,zt)  for  0=0 


(5.53) 


We  shall  again  convert  these  hypotheses  to  stochastic  differential  equations 
hy  applying  the  stochastic  differential  mile  (Theorem  1.2).  Here  we  assume 


the  appropriate  differentiability  of  the  functions  H,  a,  G,  and  g  to 
apply  the  differential  rule.  The  stochastic  differential  equations  that 
we  obtain  are  symbolically 


w  da  1  d2a  T,  ^ 


dt  + 


+ 


+ 


+  G 


i?“Bt 


for  0=1 


(*£*♦«  If 


dt  +  G 


for  0=0 

(5.5*0 


We  again  consider  some  cases.  If 

Es^° 


(5.55) 


where 


da 

SE 


I 


dai(t,x)l 


(5.56) 


then  the  detection  problem  is  singular  by  Lemma  5.2.  If 
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H  ll  b  +  H'b  =  0 


(5. 57) 


G  ^  h  +  G'h  /  0 


(5.58) 


where 


8gJt,z) 


(5.59) 


and  if  the  nonzero  terras  of  Eq.  (5.59)  are  not  a  function  of  z  ,  i.e., 
these  terms  arise  from  linear  terms  of  g  then  the  detection  problem  is 
nonsingular.  If  the  nonzero  terms  of  Eq.  (5.59)  are  functions  of  z 

T> 

then  the  detection  problem  will  be  singular  by  applying  Lemma  5.2.  If 


H  ^  b  +  H'b  =  0 


(5.60) 


G  5s  h  +  G'h  £  0 
Oz 


(5.61) 


then  we  have  the  two  hypotheses 


■  (^  +  Hla  +  lH§bTb  +  r\  +  H'a)at 


4  +  G'g\  dt  for  0  =  1 
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K'  =  dt“  (5.63) 

and  we  proceed  as  we  did  with  y'  by  taking  the  differential  of  y''. 

X  X 

With  appropriate  differentiability  assumptions  it  seems  reasonable  that 
this  procedure  will  terminate  in  a  finite  number  of  steps,  though  to  prove 
this  finite  termination  seems  difficult.  We  have  mainly  included  this 
discussion  to  indicate  the  methods  to  be  used  to  determine  if  a  detection 
problem  is  well  posed,  i.e.,  nonsingular. 
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Advanced  Research  Projects  Agency 
Department  of  Defense 
Washington,  D.C.  20301 

Director  for  Materials  Sciences 
Advanced  Research  Projects  Agency 
Department  of  Defense 
Washington,  D.C.  20301 

Headquarters 

Defense  Communications  Agency  (333) 
The  Pentagon 
Washington,  D.C.  20305 

Defense  Documentation  Center 
Attn:  TISIA 
Cameron  Station,  Bldg.  5 
Alexandria,  Virginia  22314  (20  cys) 

Director 

National  Security  Agency 

Attn:  Librarian  C-332 

Fort  George  G.  Meade,  Maryland  20755 

Weapons  Systems  Evaluation  Group 
Attn:  Daniel  W.  McElvre 

Department  of  Defense 
Washington,  D.C.  20305 


National  Security  Agency 
Attn:  R4-James  Tippet 

Office  of  Research 
Fort  George  G.  Meade,  Maryland  20755 

Central  Intelligence  Agency 
Attn:  0CR/DD  Publications 
Washington,  D.C.  20505 

Institute  for  Defense  Analyses 
400  Army-Navy  Drive 
Arlington,  Virginia  22202 

Office  of  the  Dir.  of  Defense 
Research  and  Engineering 
Advisory  Group  on  Electron  Devices 
346  Broadway,  8th  Floor 
New  York,  New  York  10013 

DEPARTMENT  OF  THE  AIR  FORCE 


AFRSTE  (Col.  Kee) 

Hqs.  USAF 

Room  ID- 429,  The  Pentagon 
Washington,  D.C.  20330 

Col.  A.  Swan 
Aerospace  Medical  Dlv. 

Brooks  AFB,  Texas  78235 

AUL3T-9663 

Maxwell  AFB,  Alabama  36112 

AFFTC  (FTBPP-2 ) 

Technical  Library 

Edwards  AFB,  California  93523 

Space  Systems  Division 
Air  Force  Systems  Command 
Attn:  SSSD 

Los  Angeles  Air  Force  Station 
Los  Angeles,  California  90045 


NOTE:  1  CY  TO  EACH  ADDRESSEE  UNLESS  OTHERWISE  INDICATED 
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Maj.  Charles  Waespy 

Technical  Div 

Deputy  for  Technology 

SSD,  AFSC  Lcs  Angeles,  Calif.  90045 

SSD  (SSTRT/Lt.  Starbuck) 

AFUPO 

Los  Angeles,  California  90045 

DGT  #6,  OAR  (LOOAR) 

Air  Force  Unit  Post  Office 
Los  Angeles,  California  90045 

Systems  Engineering  Group  (RTD) 
Technical  Information  Reference 
Branch 
Attn:  SEPIR 

Directorate  of  Engineering  Standards 
&  Technical  Information 
Wright-Patterson  AFB,  Ohio  45433 

ARL  (ARIY) 

Wright-Patterson  AFB,  Ohio  45433 
AFAL 

Wright-Patterson  AFB,  Ohio  45433 
Attn:  Dr.  H.  V.  Noble 
Attn:  Mr.  Peter  Murray 

AFAL  (AVT) 

Wright-Patterson  AFB,  Ohio  45433 

AFAL  (AVTE/R.D.  Larson) 
Wright-Patterson  AFB,  Ohio  45433 

Commanding  General 
Attn:  STEWS -WS-VT 
White  Sands  Missile  Range 
New  Mexico  88002  (2  cys) 

RADC  (EMLAL-l) 

Attn:  Documents  Library 
Griff iss  AFB,  New  York  13442 

Academy  Library  (DFSLB) 

U.S.  Air  Force  Academy 
Colorado  80840 

Lt.  Col.  Bernard  S.  Morgan 

FJSRL,  USAF  Academy 

Colorado  Springs,  Colorado  80912 


APGC  (PGBPS-12 ) 

Eglin  AFB,  Florida  32542 

AFBTR  Technical  Library 
(ETV,  MU-135) 

Patrick  AFB,  Florida  32925 

AFETR  (ETLLG-1 ) 

STINFO  Officer  (For  Library) 
Patrick  AFB,  Florida  32925 

Dr.  L.  M.  Hollingsworth 

afcrl(crn) 

L.G.  Hanscom  Field 
Bedford,  Mass.  01731 

APCRL  (CRMXLR) 

AFCRL  Research  Library,  Stop  29 
L.G.  Hanscom  Field 
Bedford,  Mass.  01731 

Department  of  the  Air  Force 
AFSC  Scientific  and  Technical 
Liaison  Office 
111  East  16th  Street 
New  York,  New  York  10003 


Col.  Robert  E.  Fontana 
EE  Dept. 

AF  Institute  of  Technology 
Wright-Patterson  AFB,  Ohio  45433 

Col.  A.  D.  Blue 

rtd(rttl) 

Bolling  AFB,  Wash.  D.C.  20332 

esd  (esti) 

L.G.  Hanscom  Field 
Bedford,  Mass.  01731  (2  cys) 

Dr.  I .  R.  Mirman 

afsc(sct) 

Andrews  AFB,  Md.  20331 
Col.  J.  D.  Warthman 

afsc(sctr) 

Andrews  AFB,  Md.  20331 
Lt.  Col.  J.  L,  Reeves 

afsc(scbb) 

Andrews  AFB,  Md.  20331  (2  cys) 
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AEDC  (ARO,  Inc.) 

Attn:  Library/Documents 
Arnold  AFB,  Tenn.  37389 

European  Office  of  Aerospace  Res. 
Shell  Building 
47  Rue  Cantersteen 
Brussels,  Belgium  (2  cys) 

Lt.  Col.  R.  Kalsich 

Chief,  Electronics  Dlv.  (SREE) 

Directorate  of  Engineering  Sci. 

Air  Force  Office  of  Sci.  Res. 

1400  Wilson  Boulevard 

Arlington,  Virginia  22209  (5  cys) 


DEPARTMENT  OF  THE  ARMY 

U.S.  Army  Research  Office 
Attn:  Physical  Sciences  Division 
3045  Columbia  Pike 
Arlington,  Virginia  22204 

Commanding  General 
U.S.  Army  Materiel  Command 
Attn:  AMCRD-  TP 
Washington,  D.C.  20315 

Commanding  General 
U.S.  Army  Strategic  Communications 
Command 

Washington,  D.C.  20315 

Commanding  Officer 
U.S.  Army  Materials  Research 
Watertown  Arsenal 
Watertown,  Massachusetts  02172 

Commanding  Officer 

U.S.  Army  Ballistics  Research  Lab. 

Attn:  V.W.  Richards 

Aberdeen  Proving  Ground 

Aberdeen,  Maryland  21005 

Commandant 

U.S.  Army  Air  Defense  School 
Attn:  Missile  Sciences  Div. 

C  &  S  Dept . 

P.0.  Box  9390 

Fort  Bliss,  Texas  79916 


Commanding  General 
U.S.  Army  Missile  Command 
Attn:  Technical  Library 
Redstone  Arsenal,  Alabama  35809 

Commanding  Genera! 

Frankford  Arsenal 

Attn:  SMUFA-L6000  (Dr.  Sidney  Ross) 
Philadelphia,  Pa.  19137 

U.S.  Army  Munitions  Command 
Attn:  Technical  Information  Branch 
Picatinney  Arsenal 
Dover,  New  Jersey  07801 

Commanding  Officer 
Harry  Diamond  Laboratories 
Attn:  Dr.  Berthold.  Altman(AMXDO-Tl) 
Connecticut  Ave.  and  Van  Ness  Street 
N.W. 

Washington,  D.C.  20438 

Commanding  Officer 
U.S.  Army  Security  Agency 
Arlington  Hall 
Arlington,  Virginia  22212 


Commanding  Officer 
U.S.  Army  Limited  War  Laboratory 
Attn:  Technical  Director 
Aberdeen  Proving  Ground 
Aberdeen,  Maryland  21005 

Commanding  Officer 

Human  Engineering  Laboratories 

Aberdeen  Proving  Ground, 

Maryland  21005 

Director 

U.S.  Army  Engineer  Geodesy, 
Intelligence  and  Mapping 
Research  and  Development  Agency 
Fort  Belvoir,  Virginia  22060 

Commandant 

U.S.  Army  Command  and  General 
Staff  College 
Attn:  Secretary 
Fort  Leavenworth,  Kansas  66270 


Page  3 
ONR ( 83 ) 
3/67 


Dr.  H.  Robl ,  Deputy  Chief  Scientist 
U.S.  Army  Research  Office  (Durham) 
Box  CM,  Duke  Station 
Durham,  North  Carolina  27706 

Commanding  Officer 

U.S.  Army  Research  Office  (Durham) 

Attn:  CRD-AA-IP  (Richard  0.  Ulsh) 

Box  CM,  Duke  Station 

Durham,  North  Carolina  27706 

Librarian 

U.S.  Military  Academy 
West  Point,  New  York  10996 

The  Walter  Reed  Institute  of  Res. 
Walter  Reed  Medical  Center 
Washington,  D.C.  20012 


CO,  U.S.  Army  Electronics  R  and  D 
Activity 

White  Sands  Missile  Range 
N.M.  88002 

Coimnanding  Officer 

U.S.  Army  Engineering  R  &  D  Lab. 

Attn:  STINP0  Branch 

Fort  Belvoir,  Virginia  22060 

Dr.  S.  Benedict  Levin,  Director 
Institute  for  Exploratory  Research 
U.S.  Army  Electronics  Command 
Fort  Monmouth,  New  Jersey  07703 

Director 

Institute  for  Exploratory  Research 
U.S.  Army  Electronics  Command 
Attn:  Mr.  Robert  0.  Parker 
Executive  Secretary, 

JSTAC  (AMSEL-XL-D) 

Fort  Monmouth,  New  Jersey  07703 

Commanding  General 
U.S.  Army  Electronics  Command 
Fort  Monmouth,  New  Jersey  07703 
Attn:  AMSEL-SC 
RD-D 
RD-G 


Commanding  General 
U.S.  Army  Electronics  Command 
Fort  Monmouth,  New  Jersey  07703 
Attn:  RD-GF 
RD-MAT 
XL-D 
XL-E 
XL-C 
XL-S 
HL-D 
HL-CT-R 
HL-CT-P 
HL-CT-L 
HL-CT-0 
HL-CT-1 
HL-CT-A 
NL-D 
NL-A 
NL-P 
NL-R 
NL-S 
KL-D 
KL-E 
KL-S 
KL-T 
KL-SM 
VL-D 
WL-D 

NOTE:  1  CY  TO  EACH  SYMBOL  LISTED 
INDIVIDUALLY  ADDRESSED 


DEPARTMENT  OF  THE  NAVY 

Chief  of  Naval  Research 
Attn:  Code  427 

Washington,  D.C.  20360  (3  cys) 

Naval  Electronics  Systems  Command 
ELEX  03 

Falls  Church,  Va.  22046  (2  cys) 

Naval  Ship  Systems  Command 
SHIP  031 

Washington,  D.C.  20360 

Naval  Ship  Systems  Command 
SHIP  035 

Washington,  D.C.  20360 

Naval  Ordnance  Systems  Command 
ORD  32 

Washington,  D.C.  20360  (2  cys) 
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Naval  Air  Systems  Command 
AIR  03 

Washington,  D.C.  20360  (2  cys) 

Commanding  Officer 
Office  of  Naval  Research  Branch 
Office 

Box  39,  Navy  No.  100  F.P.O. 

New  York,  New  York  09510  (2  cys) 

Office  of  Naval  Res.  Branch  Office 
Attn:  Deputy  Chief  Scientist 
1076  Mission  Street 
San  Francisco,  California  94103 

(2  cys) 

Commanding  Officer 
Office  of  Naval  Research  Branch 
Office 

219  South  Dearborn  Street 
Chicago,  Illinois  60604  (3  cys) 

Commanding  Officer 
Office  of  Naval  Research  Branch 
Office 

1030  East  Green  Street 
Pasadena,  Calif.  91101 

Commanding  Officer 

Office  of  Naval  Res.  Branch  Office 

207  West  24th  Street 

New  York,  New  York  10011 

Commanding  Officer 

Office  of  Naval  Res.  Branch  Office 

495  Summer  Street 

Boston,  Massachusetts  02210 

Director,  Nhval  Research  Laboratory 
Technical  Information  Officer 
Washington,  D.C. 

Attn:  Code  2000  (8  cys) 

Commander 

Naval  Air  Development  and  Material 
Center 

Johnsville,  Pennsylvania  18974 
Librarian 

U.S.  Naval  Electronics  Laboratory 
San  Diego,  California  95152  (2  cys) 


Commanding  Officer  and  Director 
U.S.  Naval  Underwater  Sound  Lab. 
Fort  Trumbull 

New  London,  Connecticut  06840 
Librarian 

U.S.  Navy  Post  Graduate  School 
Monterey,  California  93940 

Commander 

U.S.  Naval  Air  Missile  Test  Center 
Point  Mugu,  California  93041 

Director 

U.S.  Naval  Observatory 
Washington,  D.C.  20390 

Chief  of  Naval  Operations 
0P-07 

Washington,  D.C.  20360  (2  cys) 

Director,  U.S.  Naval  Security  Group 

Attn:  G43 

3801  Nebraska  Ave. 

Washington,  D.C.  20390 

Commanding  Officer 

Naval  Ordnance  Laboratory 

White  Oak,  Maryland  21502  (5  Cys) 

CO,  Naval  Ord.  Lab 
Corona,  Calif.  91720 

Commanding  Officer 

Naval  Ordnance  Test  Station 

China  Lake,  California  93555 

Commanding  Officer 
Naval  Avionics  Facility 
Indianapolis,  Indiana  46206 

Commanding  Officer 

Naval  Training  Device  Center 

Orlando,  Florida  32813 

U.S.  Naval  Weapons  Laboratory 
Dahlgren,  Virginia  22448 

Weapons  Systems  Test  Division 
Naval  Air  Test  Center 
Patuxtent  River,  Maryland  20670 
Attn:  Library 
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Head,  Tech.  Div. 

U.S.  Naval  Counter  Intelligence 
Support  Center 
Fairmont  Bldg. 

4420  N.  Fairfax  Dr. 

Arlington,  Va.  22203 


OTHER  GOVERNMENT  AGENCIES 

Mr.  Charles  F,  Yost 
Special  Assistant  to  the  Director 
of  Research 

National  Aeronautics  and  Space  Admin. 
Washington,  D.C.  20546 

Dr.  H.  Harrison,  Code  RRE 
Chief,  Electrophysics  Branch 
National  Aeronautics  and  Space  Admin. 
Washington,  D.C.  20546 

Goddard  Space  Flight  Center 
National  Aeronautics  and  Space  Ad. 
Attn:  Library,  Documents  Section 
Code  252 

Greenbelt,  Maryland  20771 

NASA  Lewis  Research  Center 
Attn:  Library 
21000  Brookpark  Road 
Cleveland,  Ohio  44135 

National  Science  Foundation 
Attn:  Dr.  John  R.  Lehmann 

Division  of  Engineering 
1800  G  Street,  N.W. 

Washington,  D.C.  20550 

U.S.  Atomic  Energy  Commission 
Division  of  Tech.  Information  Ext. 

P . 0 .  Box  62 

Oak  Ridge,  Tenn,  37831 

Los  Alamos  Scientific  Laboratory 
Attn:  Reports  Library 
P.0.  Box  1663 

Los  Alamos,  New  Mexico  87544 

NASA  Scientific  &  Technical 
Information  Facility 
Attn:  Acquisitions  Branch  (s/AK/DL) 
P.0.  Box  33 

College  Park,  Maryland  20740  (2  cys) 


Commandant  (E-2) 

U.S.  Coast  Guard  Headquarters 
Library,  Station  5-2 
Washington,  D.C.  20226 

National  Aeronautics  and  Space  Admin. 
Electronics  Research  Center 
AT/Library 

575  Technology  Square 
Cambridge,  Massachusetts  02139 

Federal  Aviation  Agency 
Information  Retrieval  Branch,  HQ-630 
800  Independence  Avenue,  S.W. 
Washington,  D.C.  20553 

U.S.  Department  of  Commerce 
National  Bureau  of  Standards 
Publications  Editor 
Center  for  Computer  Sciences  and 
Technology 

Washington,  D.C.  20234 

U.S.  Department  of  Commerce 
Environmental  Science  Services  Admin. 
Institute  for  Telecommunication 
Sciences  and  Aeronomy 
Boulder,  Colorado  80301 


NON-GOVERNMENT  AGENCIES 
Director 

Research  Laboratory  of  Electronics 
Massachusetts  Institute  of  Tech. 
Cambridge,  Massachusetts  02139 

Polytechnic  Institute  of  Brooklyn 
Attn:  Mr.  Jerome  Fox 

Research  Coordinator 
333  Jay  Street 
Brooklyn,  New  York  11201 

Director 

Columbia  Radiation  Laboratory 
Columbia  University 
538  West  120th  Street 
New  York,  New  York  10027 

Director 

Coordinated  Science  Laboratory 
University  of  Illinois 
Urbana,  Illinois  61803 
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Director 

Electronics  Research  Laboratory 
University  of  California 
Berkeley,  California  94720 

Director 

Electronic  Sciences  Laboratory 
University  of  Southern  California 
Los  Angeles,  California  90007 

Professor  A. A.  Dougal,  Director 
Laboratories  for  Electronics  and 
Related  Sciences  Reset rch 
University  of  Texas 
Austin,  Texas  78712 

Division  of  Engineering  and 
Applied  Physics 
210  Pierce  Hall 
Harvard  University 
Cambridge,  Massachusetts  02138 

Director 

Stanford  Electronics  Labs 
Stanford  University 
Stanford,  Calif.  94720 

Director 

Microwave  Laboratory 
Stanford  University 
Stanford,  California  94305 

Director 

Information  Processing  and  Control 
Systems  Laboratory 
Northwestern  University 
Evanston,  Illinois  60201 

Director 

Electronic  Systems  Res.  Laboratory 
Purdue  University 
Lafayette,  Indiana  47907 

Aerospace  Corporation 

Attn:  Library  Acquisition  Group 

P.0.  Box  95085 

Los  Angeles,  California  90045 

Professor  Nicholas  George 
California  Institute  of  Technology 
Pasadena,  California  91109 


Aeronautics  Library 

Graduate  Aeronautical  Laboratories 

California  Institute  of  Tech. 

1201  E.  California  Boulevard 
Pasadena,  California  91109 

Director,  USAF  Project  RAND 

Via:  Air  Force  Office  Liaison  Office 

The  RAND  Corporation 

Attn:  Library 

1700  Main  Street 

Santa  Monica,  California  90406 

The  Johns  Hopkins  University 
Applied  Physics  Laboratory 
Attn:  Boris  W.  Kuvshinoff 
Document  Librarian 
8621  Georgia  Avenue 
Silver  Spring,  Maryland  20910 

Hunt  Library 

Carnegie  Institute  of  Technology 
Schenley  Park 
Pittsburgh,  Pa.  15213 

Dr.  Leo  Young 

Stanford  Research  Institute 
Menlo  Park,  California  94025 

Mr.  Henry  L.  Bachmann 
Assistant  Chief  Engineer 
Wheeler  Laboratories 
122  Cuttermill  Road 
Great  Neck,  New  York  11021 

School  of  Engineering  Sciences 
Arizona  State  University 
Tempe,  Arizona  85281 

University  of  California  at 
Los  Angeles 

Department  of  Engineering 
Los  Angeles,  California  90024 

California  Institute  of  Technology 
Pasadena,  Calif.  91109 
Attn:  Documents  Library 

University  of  California 
Attn:  Library 

Santa  Barbara,  California  93106 
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Carnegie  Institute  of  Technology 
Electrical  Engineering  Dept. 
Pittsburgh,  Pa.  15213 


New  York  University 
College  of  Engineering 
New  York,  New  York  10019 

Syracuse  University 

Dept,  of  Electrical  Engineering 

Syracuse,  New  York  13210 

Yale  University 
Engineering  Department 
New  Haven,  Connecticut  06520 

Airborne  Instruments  Laboratory 
Deer  Park,  New  York  11729 

Bendix  Pacific  Division 

11600  Sherman  Way 

North  Hollywood,  California  91605 

Lockheed  Aircraft  Corp. 

P.0.  Box  504 

Sunnyvale,  California  94088 

Raytheon  Co. 

Attn:  Librarian 
Bedford,  Mass.  01730 


Emil  Schafer,  Head 

Electronics  Properties  Info  Center 

Hughes  Aircraft  Co. 

Culver  City,  Calif.  90230 


Texas  Instruments  Inc. 

Library  Acquisitions  Center, 

M/S  -  284 
P.0.  Box  5474 
Dallas,  Texas  75222 

The  University  of  Wisconsin 
College  of  Engineering 
Dept,  of  Electrical  Engineering 
Madison,  Wisconsin  53706 

General  Electric  Company 
Research  and  Development  Center 
P.0.  Box  8 

Schenectady,  New  York  12301 

The  University  of  Adelaide 
Barr  Smith  Library 
Adelaide,  South  Australia 


Westinghouse  Electric  Corporation 
Electronic  Tube  Division 
Box  284 

Elmira,  New  York  14902 

Fairchild  Research  &  Development  Lab. 
4001  Junipero  Serra  Boulevard 
Palo  Alto,  California  94304 

Bell  Telephone  Laboratories 
Electron  Device  Laboratory 
Mountain  Avenue  -  Room  2A-229 
Murray  Hill,  New  Jersey  07971 

Purdue  University  Libraries 
Periodicals  Checking  Files 
Lafayette,  Indiana  47907 

Ampex  Corporation 
401  Broadway 

Redwood  City,  California  94063 
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General  Precision,  Inc. 

Librascope  Group 
808  Wes:*.  \  Avenue 
Glendale,  California  91201 

Sperry  Rand  Research  Center 
North  Road 

Sudbury,  Massachusetts  01776 

Westinghouse  Electric  Corporation 
Defense  and  Space  Center 
Aerospace  Division  -  MS-393 
P.0.  Box  746 

Baltimore,  Maryland  21203 

Lockheed  Propulsion  Company 
Scientific  &  Technical  Library 
P.0.  Box  111 

Redlands,  California  92373 

University  of  Utah 
Dept,  of  Electrical  Engineering 
Microwave  Device  and  Physical 
Electronics  Laboratory 
Merrill  Engineering  Building 
Salt  Lake  City,  Utah  84112 

Director  of  Research 

AeroChem  Research  Laboratories,  Inc. 

P.0.  Box  12 

Princeton,  New  Jersey  08540 

Director  of  Research 
Motorola,  Inc. 

Semiconductor  Products  Division 
5005  East  McDowell  Road 
Phoenix,  Arizona  85008 

International  Business  Machines  Corp. 
Electronics  Systems  Center 
Oswego,  New  York  13827 

Stevens  Institute  of  Technology 
Department  of  Physics 
Castle  Point  Station 
Hoboken,  New  Jersey  07030 

The  University  of  Michigan 
Institute  of  Science  and  Tech. 
Technical  Documents  Service 
Box  618 

Ann  Arbor,  Michigan  48107 


Hughes  Aircraft  Company 
Library 

500  Superior  Avenue 

Newport  Beach,  California  92663 

Director 

Engineering  Design  Center 
Case  Institute  of  Technology 
10900  Euclid  Avenue 
Cleveland,  Ohio  44106 

Director 

Speech  Communications  Research 
Lab.,  Inc. 

115  West  Figueroa  Street 
Santa  Barbara,  California  93104 

Baird-Atomic  Inc. 

Library 

33  University  Ropd 
Cambridge,  Massachusetts  02138 

Director 

Electronics  Defense  Laboratories 
Syl vania  Electric  Products,  Inc. 
Library 
P.0,  Box  205 

Mountain  View,  California  94040 

TRW  Systems,  Inc. 

Semiconductor  Technology  Section 
Microelectronics  Center 
Bldg.  68,  Room  2734 
One  Space  Park 

Redondo  Beach,  California  09278 

ITT  Corporation 
ITT  Electron  Tube  Division 
Vice-President  -  Engineering 
Box  100 

Easton,  Pennsylvania  18043 

Sylvania  Electronics  Systems 
Director  of  Engineering 
Eastern  Operation 
100  First  Avenue 
Waltham,  Massachusetts  02154 

TRW  Semiconductors,  Inc. 

Research  Director 

14520  Aviation  Boulevard 

Lawndale,  California  90260 
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Director 

Communication  &  Display  R&D 
Research  &  Development  Center 
Westinghouse  Electric  Corporation 
Pittsburgh,  Pennsylvania  15235 

Raytheon  Company 
Semiconductor  Library 
350  Ellis  Street 
Mountain  View  Operation 
Mountain  View,  California  94040 
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Some  problems  in  the  filtering  and  the  detection  of  diffusion  processes  that  are 
solutions  of  stochastic  differential  equations  are  studied. 


Transition  densities  for  Markov  process  solutions  of  a  large  class  of  stochastic 
differential  equations  are  shown  to  exist  and  to  satisfy  Kolmogorov's  equations. 
These  results  extend  previously  known  results  by  allowing  the  drift  coefficient 
to  be  unbounded.  With  these  results  for  transition  densities  the  nonlinear 
filtering  problem  is  discussed  and  the  conditional  probability  of  the  state 
vector  of  the  system  conditioned  on  all  the  past  observations  is  shown  to  exis' 
and  a  stochastic  equation  is  derived  for  the  evolution  in  time  of  the  condi¬ 
tional  probability  density.  A  stochastic  differential  equation  is  also  obtained 
for  the  conditional  moments.  These  derivations  use  directly  the  continuous  time 
processes. 

Necessary  conditions  that  coincide  with  the  previously  known  sufficient  condi¬ 
tions  for  the  absolute  continuity  of  measures  corresponding  to  solutions  of 
stochastic  differential  equations  are  obtained.  Applications  are  made  to  the 
detection  of  one  diffusion  process  in  another.  Previous  results  on  the  relation 
between  detection  and  filtering  problems  are  rigorously  obtained  and  extended. 
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